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^ The effectiveness of a multi-component training 

program in career decision-making (CDM) was investigated. A 
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sequence of planned decision-making actions, was administered to a 
random half of a sample of students, primarily from third-year 
English classes at Mountain View High School in California. Control 
students did not receive any CDM training. Three criterion measures 
assessed the effectiveness of the CDM skills treatment. They were the 
Check List of Decision-Making Ability, which measures the self-rated 
efficacy estimates of ability to perform certain decision behaviors 
and provides data from the affective domain; the Career 
Decision-Making Skills Assessment Exercise, a cognitive instrument 
that measures knowledge of facts and procedures relevant to CDM; and 
Career Decision Simulation, an individually administered instrument 
that assesses performance of a simulated decision task. Results 
provided evidence that a structured training program in CDM based on 
social learning principles is effective in producing superior scores 
on measures of CDM competence. (Appendixes, amounting to over -'^ 
one-half of the report, include a student workbook and master lesson 
plans for the CDM training program, the instruments, and data 
tables . ) ( YLB) 
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THE EFFECT OF DECICJ.ON TRAINING ON CAREER DECISION-MAKING 
COMPETENCE 

\ . 
BRIEt ^ * 

. 7 ■ ■ _ . 

./ ■ . . ■ , • 

/ 

/ 

uiremenl:: 

Issues regarding identification and definition of relevant career de- 
velo'pment domains, mo^t appropriate con tent and modes of instruction, and 
procedures and instruments used to assess career education curriculums are 
largely unresolved . This research was undertaken to answer some of the 
fundamental questions being asked by consumers of career development 
programs. • 



Procedure : 

Students from third-year high school English classes were stratified 
by sex and then randomly divided into experimental and control groups. Ex- 
perimental students participated in a career decision-making skills (CDM) 
training p.rogram consisting of seven weekly meetings of about 1 hour each 
and completed, a variety of homework assignments. The control group did not 
receive any CDM trajji^ng . Crl.L^^ used to assess the COM skills 

treatment wereThe following: (a) Check List of Decision-Making Ability, S 
administered before and after training, which measures self-rated efficacy 
estimates of ability to perform certain decision behaviors; (b) Career 
Decision-Making Skills Assessment Exercise, which measures knowled[^e of 
facts and procedures relevant to CDM; and (c) Career Decision Simulation, 
an individually administfired instrument that assesses how well the indi- 
vidual performs a simulated decision task. 

Findings: ' . , 

Results provide evidence that a structured training program in career 
decisionmaking based on social learning principles is effective in produc- 
ing superior scores on measures of career decision-making competence. 

Utilization of Findings: ^ • . 

This investigation focused on a group, that represents p. prime recruit- 
ing population for the Army — secondary school students who ere about to seek 
their first full-time employment or are looking for educational and training 
opportunities. Findings suggest how students use occupational information 
to arrive at career choices. Results suggest formats as* sequences of occu- 
pational information that should be considered in any kind of recruitment 
effort seeking to present career opportunities. ' • 
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TMIi: KFFECT OF DECISION TE^ININC: ON .CAREER 
DECISION-MAKINC; COMPETENCE 



INTKODUCTTON AND REVIEW OF THE LITERATURE ^ 

Helping pciopLci makci .saLisFying career dcicisions has always been a 
major concern of guidance practitioners in their various work settings, 
and the career education movement has focused significant attention on the 
development of career decision-making (CDM) skills as a primary educational 
objective. Teaching people effective decision-inaking skill.v was identified 
as a major goal of counseling in a frequently cited art icle (Krumboltz , 
1966) written more than a decade ago. Yet, despite a considerable amount 
of attention in this area, CDM remains an inadequately understood educa- 
ti\onal and psychological phenomenon. . 

Attempts to study the effectiveness or "goodness" of decisionmaking 
have p.royen difficult.^ in a review article, Krum.boltz, Becker-Haven ,. and 
liurnett (1979) stated that the measurement of career decision-making ability 
must rely on some inferential processes. Currently available . instruments 
presuppose that individuals possessing CDM skills know about ' occupations , 
are. consistent in their aspirations, and have developed some kind of strategy 
for dealing with career-related problems and decisions. Most research has 
--relied on measures of attitudes or knowledge about what are assumed to he 
appropriate career exploration activities, such as defining goals, generat- 
ing alternatives, and J^seeking relevant information. 

Data are scarce on the actual decision-making process in action (KatJi, 
Norris, 6 Pears, 1978). Even rarer are experimental studies attempting to 
assess the effectiveness of interventions designed to develop or improve 
c:i)M skills. As in all .career development outcome areas, progress has been 
limited by a lack of consensus on definitions and outcome criteria, a lack 
of adequate measurement tools, and weak design and data analysis features 
of the few studies that have-^been reported (Oliver, 1979; Super & Hall, 
1978). 



Career D ecision -Mak ing Mod els 

liecause the li^erature on career development theories and career choice 
is so vast, the following discussion will be restricted to those works that 
address the more limited focus of this research: . developing an effective 
and testable model for acquiring and using CDM skills. But what exactly 
are CDM skills? Can they be specified, defined, and taught in a useful way? 

t ■ - 

Subsequent section:; examine various conceptualizations of CDM skills 

in the form of models t^hat depict an optimal CDM process — a set of activities 

designed to produce consistently desirable and preferred outcomes for the 

decider. These models prescribe assequence of deliberate, planned steps or 

actions. Such formulations will be referred to as rational CDM models. 



Prescriptive Versus Descriptiive Models ' - I 

i " 

Several important distinctions are necessary. First, general reviews 
by Becker and McClintock (1967), Lee (1971), and Jepsen and Dilley (1974) 
distinguish between two common ^approaches to conceptualising CDM: ' descrip- 
tive and prescriptive models. " ' ' ; 

Descriptive models are usually theory-based and attempt to represent 
.and predict the way in which individuals naturally make decisions. Descrip- 
tive theorists (e .g . , Ginzberg, 1951; Holland, 1973; Super, et nl., 1963; 
Tiedeman & O'Hara, 1963) are typically concerned with personality factors 
and developmental stages. Descriptive models are frequently explanations 
of the relations between, vocational choice and factors such as maturity, 
self-concept, cognitive s.tyle', and other psychological constructs, A more 
recent social learning theory of CDM (Krumboltz 1979)' emphasizes genetic, 
environmental, and learning experience factors in describing the vocational 
choice process. 

Prescriptive models tend to be more explicit and focus on the actual 
process rather than ::he origins of decisionmaking. Rules are specified;. 
The intent is to provide a framework or set cf guidelines thatlead to a 
strategy applicable to a range of decision si tua tions . Because prescrip- 
tive CDM models tend to be more concrete and outcome-oriented, they bear 
some resemblance to the problem-solving literature. 

Rational CDM models are designed to resolve decisional conflicts and 
are usually couched in terms of producing better results. Thus, it is not 
surprising that problem solving has had a strong influence on these models' 
development. However, it is important to niake at least a theoretical dis-' 
tinction. Problem-solving strategies usually apply to more tangible and 
circumscribed situat-ions in which the possible outcomes can be clearly and 
objectively assessed. Most importantly, in problem solving the best re- 
sponse or option will eventually become apparent; there often is one correct 
solution. 

' CDM is necessarily a much more ambiguous operation because there are 
no objectively correct career choices. Each person uses a unique set of 
needs, interests, beliefs, and values while acquiring and interpreting 
otherwise objective information about alternatives. Outcomes cannot be 
easily quantified, and evaluation of outcomes is left to the. decider. Dif- 
ferent outcomes can be optimal for different people, depending on idiosyn- 
cratic preferences and judgmental criteria. Nevertheless, many basic / 
problem-solving techniques, such as brainstorming and estimating costs and : 
benefits associated with an alternative, are incorporated in models of 
career decisionmaking (D'Zurrila & Goldfried, 1971). 

Advocates of training in rational decisionmaking contend that follow- 
ing the procedures specified in their models will result in making a greater 
percentage of satisfying decisions, regardless of the approach to evaluating 
outcomes. This kind of hypothesis requires some kind of longitudinal evalu- 
ation and has not been investigated to date. Problems that arise in any 
attempt to evaluate long-term decision outcomes are covered in a subsequent 
section. - 
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Assumptions^ 



Before examining any rational career decision-making model, it is im- 
portant to review several basic assumptions. The following promises are 
adopted from the decision-making conceptual framework proposed by Jepsen 
and Dilley (i:974) . 

First, Investigators need a person faced with a career decision situ- 
ation (such as selecting a program of study, a particular schoolc3 a *traln- 
Ung experience, or a job) and the availability of appropriate information. 
Useful information is available both within and outside the decider. It 
is further assumed that the decider will generate two or more alternatives 
for consideration, and tl;at several outcomes or consequences can be antici- 
pated for each alternative. For each outcome, its probability of occurrence 
and the degree to which it might satisfy the decider's goals could also be 
estimated. • ; - 

, • \ 

A rational CDM model would guide the decider to une some kind of logi- 
cal strategy to systematically eliminate alternatives. Ideally, the bAst 
option eventually would be identified, and the decider would make the neces- 
sary commitment to pursue this alternative. Other desirable characteristics 
for a rational model would include these steps: (a) a specification of 
steps, (b) an operational definition of the steps, and (c) a rationale for 
sequencing the steps. 

An important point to make here is that not everyone approves of the \ 
traditional "rational comprehensive*' approach to "decis ionmaking. In. his \ 
famous article, **The Science of Muddlinir Through," Charles Lindblom (1959) 
argued that most choice behavior does not conform to the "normative pre- 
cepts" of rational theory.- He cited factors such as vaguely defined or . 
inconsistent goals, limited information about alternatives and their con- 
sequences, and "uncontrollable contextual phenomena" as contributing to 
the discrepancy between theory and practice. Lindblom felt that these and 
other circumstances conspire to make adherence to any prescribed rational 
decision-making model a virtual impossibility. Given such overwhelming 
constraints, he suggested that decisionmakers are forced to "muddle through" 
their problems, relying on past experience, instincts, and good fortune. 
At best, he saw decisionmaking as characterized by a set of "successive 
limited comparisons." [ 

Nearly 20 years later, Kritek and Colton (1978) took Mndblom's argu- 
ment a step further. They consider the process of muddling through to 'be 
a desired virtue, not a lamentable necessity".- Kritek and Colton advocate 
muddling as a normal life strategy. Their -experience from 1972 to 1975 in 
conducting on-the-job professional development training for high school 
administrators convinced them of the value of avoiding p respeci f ication 
of program goals and capitalizing on opportunism — that is, looking upon 
unforeseen events and obstacles as useful information to be -accounted for 
and circumvented if necessary . In their view, the expectation of ration- 
ality limits the. capacity to muddle' through . 

Another dissenting opinion from pure models of rational choice has 
been offered by James March of the -Stanford C;raduate School of Business. 
March, a renowned expert in decision science, organizational management. 



operations analysis, and other forms of decision engineering, takes some 
playful, yet sobering pokes at the assumption of rationality. In a recent 
paper, March (1978) stated, 

; Rational choice involves two kinds of guesses: guesses 

about future consequences of current actions and guesses about 
future preferences for those consequences./.. We try to imag- 
ine what will happen in the future as a result of our actions 
and we try to imagine how we shall evaluate what will happen. 
Neither guess is necessarily, easy. Anticipating future conse- 
quences of present decisions is often subject to substantial 
error. Anticipating future preferences is often confusing., 
Theories of rational choice are primarily theories/of these 
two guesses and how we deal with their complications. .. . 

Student^ ' decisionmaking under uncertainty have identi- 
fied a number (m ways in which a classical model of how al- 
ternatives are assessed in terms of their consequences is neither 
descriptive of behavior nor a good guide in choice situations. 
As a result of these efforts, some of our ideas about how the 
first guess is made and how it ought to be made have .changed. 
. Since the early writings of Herbert A. Simon (1957), for exam- 
ple, bounded rationality has come to be recognized widely, 
though not universally, both as an accurate portrayal of much 
choice ^behavior and ^as a normatively sensible adjustment to the 
costs and character of information gathering and processing by 
human beings. 

March (1978) goes 6n to argue for the intelligence of ambiguity in 
decision situations. He sees a number of alternatives to calculated - ra- 
tionality/ In discussing alternative rationalities, he suggests limited, 

contextual, process, adaptive, and posterior rationali ty concepts amorig 
others. A full discussion of each of these ideas is not appropriate here, 
but. the need to be specific about, meaning when discussing the merits of 
any model of rationality is apparent. r 

In. the discussions that follow, COM models wrll be- dalled rational in^ 
the sense that they prescribe a sequence of 'suggested actions that can be 
operationally defined and have^a rationale for their sequencing. This ' 
designation does no,t suggest chat alternative models are irrational or even 
/less intelligent—just that they are less well articulated by their advo- 
cates and less well -understood by this report's authors.' The. models to be 
discussed fall short of representing pure, calculated, empirical Vationality 
as described by March and^others. They are more akin to Simon's ''satisfic- 
in^" principal in bounded rationality or March's notioh.of limited ration- 
ality. As in limited rationality, individuals making career choices inevi- 
tably simplify the problem because of difficulties in.,anticipating or 
considering all alternatives and all information. ' cWeer deciders also , 
benefit f rom incrementalism and employment of simple search rules and oc- 
casionally work backward from a step in their models. They cannot, however, 
avoid uncertainty. In making projections or estimations about uncertain 
future personal preferences and .economic conditions ,. CDM embraces aspects 
of the classic rational choice model. 
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Proscint: StiaLo of the Art o . 

Many f-uithors tise Llio word rational ind L.scrimLnately in their* discus- 
sions of the COM process. They seem to assume implicitly that rational 
approach to career decisionmaking is clearly tlie most .e Pf ective and widely 
used strategy. Very, few of these c-nthusiasts list specific concepts and 
skills to he taught, how they will be tauj',ht , and how attainm'ent of a ra-^ 
tionaJ C:i)M strategy can be generalix.ed or measured. 

Kortunately, some promising groundwork has been done. Clelatt (1962) 
offijred one of the first prescriptions for engaging in rational CDM activi- 
ties. Clelatt *s primary interest was tlie use of information in making "good" 
decisions. His model depicts the ways in which a decider organises inj'or- 
mntion to pursue a preferred course of action toward a career goal. He 
suggested that at any given point the' information can lead .to a decision 
or stimulate add ltional> exploration requiring more information. Oelatt 
posited three distinct information systems: (a) predictive information 
about probable consequences of alternative actions, (b) values regarding 
tiie decider's j) reference among anticipated outcomes, and (c) decision cri- 
teria for <ival»iatlng outcomes. He emphasised that good decisions require 
^•ippropr latJLi data In each of these Information systems. 

fllarke, Celatt, and I.evlne (1965) contended that there are'at least 
two requiremenlrs for effective decisionmaking: (a) adequate Information, 
and (b) an effective strategy for analysing, organising, and synthesizing 
this Information into a choice.However, these authors madje no attempt to 
describe such a strategy. fn a later-work, (ielatt and Clarke (1967) dis- 
cussed the role of subjective probability estimates in evaluating career 
o|)tions. All three of the above writings dealt with" the^charact eristics* 
of relevant In format' Ion sources and how such data could be use full y^prgan- 
Ised by. the decider. fielatt and his associates were not particularly con- 
cerned with other dimensions of a rational model. They did not discuss 
[low this elaborate information system might *lead to a mcJre comprehensive 
diic^Ls Ion-making strategy. . 

. * Martin K.ltx. (sec; I96'ii 1966, 1969a and b, 197"3, 197!3,"1976 , 1977 , / 
and 197H) has written extensively on the sub/ject of making better decisions 
and the need for a normative^ CDM model. lake Celatt, Kats seems to have 
concentrated on explaiinlng a particular component of a rational CDM model. 
Kats (1966) suggests that che rhost ef f ect<lve CDM strategy .begins with the. 
.decider generating a list of dominant personal values. These values can 
then be scaled according to their relative importance or magnitudes. Hlach 
value can also be assigned a threshold level reflecting the decider's per- 
sonal requirements for that particii-lar value. At this point, Kats sugges.ts 
that* alternative actions are formulated, and the decider should estimate" 
the strength of return each alternative offers relative to the thresho'ld 
level of each chosen value. The sum of products for strength of rieturn 
and * magnitude of values produces a value return figure for each option. 
Then, anticipated probabilities for success on each option can be multi- 
plied by the previously calculated value return to obtain an expected value 
score. According to Kats, the best strategy in this logical process is to. 
choose that alternative for which the expected- value calculation is great- 
est". Kats's plan is a fairly elaborate procedure for dealing with the 
value component of a rational CDM model, but it shows no evidence as to 
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assiiteH 1 "° °P '"^"'^y Project, a network of computer- 
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the bWw" ^7 P^'^.l'^^ i"^^ 80-1 language and' then identifying 

aii the blocks and strengths that either hinder or help reach the goal 
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ing where, when., and hbw to begin the decision-making process Roos et al 
fserief^f ^7^^^ of "occupational .choice that provides structure" through 
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-empirical ^nn' advocates a variant of the rational- 

elaborated making ,:hoices, none is comprehensive or well-. ; ; 
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ineir model contain-, seven separate steps, listed below. , • i • ' 



1. Defining the problem; 

2. Generating; alternative "problem^solut] 

' ■' ■ 'f" 
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3. Collecting information about . the alternatives; 



•Examining the consequences oC^the alternatives; 

Revaluing goals, alternatives, and consequences; 

Making the decision or tentatively selecting an alternative 
contingent upon net;; developments and new opportunities; and 

7- Generalizing the decision-making process to new problem^. 

Models of this sort provide the l.ramework for most programs in which 
CDM skills are currently taught. Although such guidelines seem logically - 
sound and have a certain practical appeal, data to substantiate their ef- 
fectiveness are simpl'y not* available . Part of the problem is due to the 
inadequacy of the models themselves — it is hard to validate something that 
is inadequately defined or vaguely explained- 

An even larg'er obstacle to evaluating the merits of any CDM model is 
the pr.oblem of inadequate instrumentation mentioned earlier. Researchers 
need to refine the validity and reliability of existing measures and develop 
innovative tools to tap unmeasured variables, particularly in the performance 
dcjmain. Also, a lack of consensus on the meaning of basic terminology and 
a Bewildering array of basic learner objectives further confound the evalu- 
ation picture. But despite these limitations, research on vocational devel- 
-opment and 'career choice is being conducted at several different levels. 

Career Decision-Making Research 

A, review of CDM r^esearch conducted from 1969 through 1974 (Mitchell', 
Jones, & Krumboltz, 19,75) yielded only 45 studies of the influence of psy- 
chological factors oa career ^decisions . These studies were dominated by 
two major) theoretical orientations . Almost "half of the studies dealt with 
Holland's (1973) vocational typolQgy, while a significant percentage of the ^ 
remaining investigations . pursued the self-concept formulations of Super 
(1963) and others. Thoresen and Ewart (1976) have written a thorough analy- 
sis of the contributions and limitations of the above lines of inquiry. They 
emphasize the weak correlational data base and trait-state assumptions in 
Holland-s work on vocational types and preferences. Just as problematic is 
the unresolved tautology" that characterizes the self-concept-work roles 
research done by Super and his associates. To observe that . self-concepts 
and work roles tend to be related tells us little about how these vocational 
identities develop and what kinds of experiences or behaviors, lead to the 
successful realization of a job congruent with a person's self-perceptions. 

An experimental approach that seeks to find influencing factors through" 
systematic control and observation is needed. While past studies represent 
commendable efforts and have generated several useful guidance tools (for 
example, Holland's 1970 Self-Directed Search ) conceptualizing vocational' 
interests as fixed ;perppnality t:raits has done little to help us understand 
how vocational interests develop or subsequently change, and what conditions 
favor sound career selection. . * t^xn. \ 



Social ^Learning Approaches 

^ Some researchers contend that career aspirations are best explained as 
a function of the feedback, people receive from their environment, the occu- 
pational models they emulate, and the imagas they find associated with 
various work activities (Krumboltz & Rude, 1980). As people learn about 
work thc^ugh their own expediences and resulting belief systems, counselors 
and teacliers can play a key role in shaping those experiences and beliefs - 
in a positive way. ' Research • has shown that certain kinds of structured, 
salf-guided mastery experiences can become power ful reinforcers in strength- 
ening or increasing target behaviors. Thus, it seemed logical to -assume 
.that a successful experience in exploring a prospective job might lead to 
other kinds of career-related activity. Krumboltz and his associates at 
the Stanford School of Education (see Krumboltz, Sheppard, Jones, Johnson, 
& Baker, 1937; Krumboltz, Baker, & Johnson, 1968) deva^ oped a set of Job 
Experience Kits to study the effects on studenfs from tue chance to work 
at simulated tasks and problems typical of certain occupations. 

Several significant findings emer^;ed from the series of studies using 
the Job. Experience Kits. For exdmple^, it was found that the use of. the 
cits consistently produced more self-reported interest in a -iven job and 
nore actual information-seeking than did the use of such standard job in- 
formation media and formats as pamphlets, occupational btiefs, and films. 
Furthetmore, those students reinforced (given positive verbal ' feedback) for 
using certain kits did more cSreer exploration in those job areas and re- 
ported a greater preference for related occupational activities than did 
students not reinforced. Thase results suggest that career aspirations may 
at least partially result from the differential reinforcement people get fdr 
engaging in certain activities or pursuing various interests as children. 



A social learning viewpoint portrays career development as resulting 
from an individual's learning experiences. People are seen as having some 
power to iJhape' their own destinies by devising learning experiences .of their 
own choosing, by exploring compelling alternatives, and by learning a logi- 
cal process of selecting the most appropriate options (Krumboltz, 1979). 
This theory is based on the assumption that certain conditions and events 
lead to the effective use of CDM cognitive and performance skills. Some 
preliminary findings on the relative effectiveness of a structured 90-minute 
training program in rational CDM did not demonstrate the superiority of a 
restricted application of these procedures (Krumboltz et al., 1979). It 
should be noted, though, that questions concerning the adequacy of such a 
brief treatment and certain design features of the principal dependent mea- 
sure make interpretation of the aove experiment extremely difficult. 

Decision Styles . ' 

Many references (for e5c&mp'le, the rational models cited earlier) imply 
that, there is a single best or ideal model for CDM, ignoring the likely pos- 
sibility that alternative approaches might be more effective for some indi- 
viduals (Jones, 1976). Furthermore, the decision-making strategy advocated 
by these models rs a highly rational, lock-step sequence approach to solving 
problems. Is this kind of prescriptidn the most desirable way to teach 
decisionmaking? , • ' . 
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Work by Baumgardner and Rappoport (1974) on the analytical-intuitive 
dimension of cognitive style used in making career-related decisions sug- 
gested that students' career choices were not* necessarily reflected in ra- 
tional processes. Many of their subjects showed little concern for objec- 
tive or authoritative information, or for making decisions in a systematic 
manner. Again, however, there is no way of knowing how individuals with 
such predispositions fared with, their decisions or how they might respond 
to a compreheinsive CDM training experience. 

Several studies on individual styles of decisionmaking (see .Janis &. 
Mann, 1977; Johnson, 1978; and Scherba, 1979) strongly suggest that decision 
styles are not consist.ent across decision situations. Variables such as 
percei'ved importance or career-relatedness , the amount of associated stress, 
and selfref ficacy or outcome expectations may all. interact in complex ways 
to affect how people make decisions. For example, Janis and Mann, working 
with a variety of populations, developed a conflict-theory model of decision- 
making, that suggests, the way people cope with resolving a difficult choice 
is determined by the presence or absence of three conditions: awareness of 
the risks involved , hope of finding a better solution, and the time^ avail- 
able in which to make the decision. In their research they found that a 
person might employ any of five empirically derived decision styles (uncon- 
flicted adherence, unconflicted change, de fensive avoidance , hypervigilance , 
or vigilance^ — the preferred style) depending on the characteristics of the 
above-mentioned conditions. ' . 

Scherbals (1979) doctoral dissertation was based on a 287-item decision- 
making questionnaire developed to measure actions and thoughts representing 
five different decision-making styles: rational, impulsive, intuitive, de- 
pendent, and fatalistic. Style inferences were derived from self-reports 
of the way in which five previous decisions ^(three career-related, two not 
career-related) were made. The magnitude of the correlations among styles 
varied with the individual decision situations and was not consistent for 
either the career or noncareer decision situations. In other words, de- 
cision styles for individuals varied widely across different kinds of de- 
cision situations. 

Perhaps several alternative models are needed. The goal should be to 
approximate more realistically the role of differences in individual de- 
cision styles across various situations. People need to learn which methods 
work best for them under particular circumstances and for particular kinds 
of choices. 

. • ■ * , -- 

Also, how much do we know about how people actually make decisions? 
Rigorous descriptive research is badly needed. Such studies might clarify 
prescriptive assump*:ions and help identify the behavioral* characteristics 
of successful decision makers (Thoresen & Ewart , 1976), Dinklage's (1968) 
doctoral dissertation is a good example of promising work in this area. 
She analyzed hundreds of structured interviews with high school students 
and identified eight discrete decision-making strategies used for personal, 
educational, and vocational planning. She labeled 'these styles impulsive, 
fatalistic, compliant, delaying, agonizing, planning, intuitive, and para- 
lytic. The most common strategy used by the subjects in Dinklage's study- 
was a planning orientation, but this-- approach only, accounted for about 25% 



none of the Boston-area schools pari 
ticipating in her research offered specific training in CDM sKus and 

infl^r^: styr:r." - efLctivene:rof^th:se 

Decision-MakinP T raining Programs 
Varmhorst 5 C«rei ^QT^l T '^f ^''^^ '''>'>'^'' ""^ developed Deciding (Celatt, 

decl=lc„:/" :;h"y d le^^^^S )^:^"'"^'^ '"^ "''""^ 

sKiiis IS the one developed by Winefordnpr (^Q7f^^ or^ri k-t . o . ni^t^J-ug 
Appalachian Educational Laboratories ^^^^ associates at the 

.h. J A alsb.be noted that several programs have been developed with ° 

waters ana Goodman (1977) described a CDM skills training course at the 
Continuum Center for Adult Counseling and Leadership Trafm'ng at Oakland " 
University m Rochester, Mich. Farmer (1976) developed the inquiry Protect 
computer-assisted counseling for adiilt-Q mo/- • J-'"^ enquiry Project, 

processing c-mhin^v r ^ ^^^^ wrings sophisticated information- 

processing capability to the aid of midcareer changers. Also the Prnaramc; 
and Practices, ^ Life Care er D evelop ment Processes fl97M nr^^ ! Pro££arns 
APGA-Imoact-FRTr /rADc tt — }~T. ^''<^ni. processes uy/^; .produced by the 

curriculum id!as for . h 'S°' "^'f" Development contains useful 

i.uiLj.cuium laeas.for a broad range of audiences. 

It should be emphasized, however, that all of these resources and 
training procedures provide various conceptualizations of what constitutes 
good career decisionmaking. None provides any evidence of ' impact Joes 
all this well-intentioned expert advice actually improve the quaUtv of de- 
cisions made bv its consnmerQ' Tr, om,,^o • , . HUd±±ty or ae- , . 

lacked the tnnL f ^""^"""e". To emphasize a key point, researchers have 
lacked the tools for assessing in what way and how well people make de- 
cisions Investigators need to develop some explicit crLe^ia for effective 
L\^^:re"h:::°crui"rL!'"^ -?.--^ate instrumf nts\"at 

Evaluation of Decision Training 

None of the prescriptive CDM models or training programs developed so 
far has been subjected to thorough empirical testing. However previous 
ITZ . that certain interventions do result in increased career- 

relevant behavior. Krumboltz and Thoresen (1964) and Krum.oltz and Schroeder 
.(1965) demonstrated how the us4 of reinforcement and model reinforcement ' 
counseling methods increased the information-seeking behavior of hjgh school 
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students.. Seeking appropriate information is one of the skills specified 
in all^of Jfne rational ,.CDM models. " ' ^ 

Riiss;:ill and'Thoresen (1976) found that using a' simple set of 'guide- 
lines helped children achieve a significant increase .in the number of al- 
ternatives considered as well as identify more probable consequences for 
their actions in decision-making situations. Birk (1976) reported that 
hij^h- school women considered a wider array of career options, and Ferguson 
(1976) found improved self-reported estimates of CDM ability in community 
college students as a result of participating in structured CDM: classes. 
Perhaps it is possible to devise appropriate learning experiences that will 
result in incre^ased use of other CDM skills assumed relevant to career 
development. . ~ . 

The goal should be to devise a program that develops all the skills 
deemed important in making sound career decisions. Partial understanding 
and mastery of the decisionTmaking process can be a^'^friistrating and poten- 
tially dangerous as having only, some o f the. skills an,d,;j udgment required to 
drive a car. Of course, officials have developed fairly ..reliable, assessment 
procedures to assure that car drivers have basic competencies. If making 
career decisions can be* elevated to a similar. level of importance, maybe 
Investigators should begin looking for better ways to assess . competencies 
here as well . 

• . • . :\, y . 

. \- • . 

. ' The Problem 

Although a few studies on t le impact of training programs suggest an 
increase in certain relevant belaviors, CDM assessment needs' (a) better 
operational definitions of CDM skills (b) ways to measure all components 
of decisionmaking, not just ways to. generate alternatives and seek infor- 
-mation; (c) procedures to oBserve decision-making behaviorsv directly , hot ^ 
merely through self-report; (d) ways:.to determine the practical effects of ; 
performing relevant CDM behaviors; and (e)/. to developvmultipie indexes of ' 
CDM competence and specify the constructs those indexes are based on. 
Seeking solutions to all. of these problems is beyond the scope of a single 
study, but several problems can be looked at simultaneously.. / . 

A major issue facing CDM research concerns the point at which tQ assess 
the quality of a decision. This issue boils down to defining what consti- • 
tutes a good decision and has generated controversy among psychologists 
and -philosophers . . Varenhorst (1975) makes a vitally important distinction 
between a decision and an outcome: /y' 

Many people overlook the dif ference between a decision and 
an outcome. People frequently equate a good decision with a good 
outcome and a bad decision as the reverse. If this is accurate 
then an evaluation of a decision must always be delayed until the 
outcome is revealed. This presents some problems because the out- 
comes of decisions frequently change as events occur or circum- 
stances change. 
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Varenhorstjs point is eispecially compelling in approaching the chore 
of . evaluating career decisions. At what point in a career is it appropri- 
:ate to assess the quality of decisions that led to it? Do . investigators 
obtain measures during the first day on the job, 6 months later, 5 years 
later, or when? What kind of instruments are used? Can some meaningful 
measures of success or satisfaction be devised? Do investigators rely on 
self-report or on objective, externally applied criteria? As Katz (1975) 
points out ,,. it would, be tremendously difficult to isolate elements attribut- 
able to CDM factors in this kind of post hoc analysis. Unfortunately, 
reports of career satisfaction are the product of complex interactions 
among- random, variables, such as health, personal relationships, physical 
environment,^ and prevailing "economic and social conditions. Add to this, 
the fact that life values are . subject to periodic change as a result of 
new learning experiences, and the result is a messy and unreliable measure- 
ment picture. . : 

The problems with evaluating remote or even intermediate career de- 
cision 'outcomes suggest that assessment should be based on the immediate 
outcome's . of . the process or procedures used to arrive at the decision. 
Again', here is a quote from Varenhorst's (1975) paper: 

The critical difference "Hie tween a decision and an outcome' 
is the degree of control^ one has in determining each. A person 
has complete control oyer the options he chooses, perhaps not 
the numbers or kinds of options available to him, but complete 

^ control ovef the choice of those that are available to him. On 
the other hand he has no control over the outcome that results 
from what he has decided. He can think* about, predict or guess 
what the: result may be, and this req-uires skills, but in the 
end he does not control which, outcome results. He does not de- 

• cide his outcome. 

This means' that decisions must be evaluated at. the time of 
decision and on *the basis of the process that was used. The 
•process involves the careful examination of personal values"," the 
< collecting of information about alternatives, outcomes, and the 
probabilities of outcomes, as well as the. ability to weigh all 
of these factors in finally making the decision. ^ 

VareAhorst argues her decision versus outcome point f or fully in the 
above passage and seems to not only e-xaggerate her case, but leaves a di- 
lemma. First, it seems extreme to assert that deciders have no control * 
over the outcomes resulting from their decisions; Such a- fatalistic con-, 
tention contradicts her advocacy and description of behaviors, that facili- 
tate the/ decision-making process up XQ_the time;,of choice': Vigilant ap- 
. plications of these' same behaviors at times subsequent''''to the actual decision 
will not avert chance occurrences, but will nevertheless leave a person with 
Some measure. of control in responding to and accommodating new information. 
Making a' choice does not mean relinquishing any further influence on the 
destiny of , its /outcome . ^ ^ 

; ^ However, Varenhorst fai^w t;.^ specify any procedure for evaluating de- 
cision processes (such as 'gathering information, e^camining personal "values , 
evalujating probable outcomes, and so forth). Researchers still do not know 



what kindsof processes or behaviors (used to what extent). lead to better 
decision outcomes. What is the point of advocating any particular approach 
to making decisions if there is no way to assess its comparative 
effectiveness? 

Criteria are needed for assessing aspeccs of the decision-making pro- 
cess, but these processes/ should be evaluated in .terms of the resulting 
immediate decision outcome. The authors' argument with Varenhorst implies 
more than a trivial semantic distinction regarding the meaning attached to 
the word ^'outcome," although part of the disagreement may arise from her 
more limited use of outcome to mean long-range consequences. 

Using certain procedures and engaging in certain behaviors such as 
generating alternatives, weighing personal values, and evaluating possible 
outcomes can be directly linked to real consequences at the time of de- 
cision. In other words, it is quite reasonable to evaluate the outcome 
of a decision on its merits at the ^me it is made, before new information 
or unforeseen chance occurrences cai affect subjective satisfaction with 
the choice. Such an evaluation is based on the decider's current state of • 
knowledge and preferences, which, given the highly dynamic nature of both, 
seems to be a sensible criterion. ^ 

Of course, it would be desirable to know whether certain discrete, de- 
monstrable, and learnable decision-making behaviors lead to better decision 
outcomes in the long run. Outcomes in this sense refer to actually experi- 
encing the consequences of a choice (for example, knowing what it is like to 
work as a librarian 5 days a week for 3 years) . This ultimate criterion 
of decision-making competence is difficult to relate to specific procedures 
or behaviors used and options identified at the tiir.e of choice for a number 
of reasons. First, this kind of data would have to be collected and stored 
in the context of a longitudinal design, as already pointed out. Second, 
how do researchers retrospectively evaluate alternatives not chosen? It 
is impossible to know what kinds of surprises, both fortuitous and unpleas- 
ant, might have been encountered on any path hot taken. Finally, research- 
ers Would also- be faced with the problem of applying a suitable objective 
criterion to assess the goodness of some ultimate career decision outcome. 
To avoid all the subjective bias inherent in measures of self-reported career 
or job satisfaction, what data .should be collected? Do researchers count 
thenumber of progeny, length of. obituary, size of estate, number of friends, 
extent of travels, number of offices held, or what? Once again, idiosyn- 
cratic values preferences arise, making it unreasonable to expect any kind 
of consensus on what the most important criteria should be. 

For the above reasons, *in this ^ analysis of decision outcomes was 
based on data generated by performance on a CDM simulation task. This pro- 
cedure allows evaluation of the goodness of a career decision according to 
each decider's own specified value preferences, and to relate the numerical 
goodness of choice to quantitative measures of behaviors (such as information 
seeking) used to* make the decision. An implicit assumption, not investigated 
here, is that whatever procedures produce .be ttisr immediate decisions, other 
ones will also produce a greater percentage of good decisions over the long 
run. * 
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Indexes of Career Decision-Making Competience 



What do CDM processes, CDM skills, or CDM competence mean? Research- 
ers refer to career decisionmaking! (CDM) as if it were a global concept, 
land previous research has often settled for attempts to obtain a single' 
measure of this phenomenon (see Krumboltz, Becker-Haven, & Burnett, 1979; ' 
Super & Hall, 1978). Making career decisions is not much different than 
making other kinds of important decisions — it involves making a different 
choice between two or among more options. It is probably safe to assume 
that whenever. a person is aware of a consequential decision, that aware- 
ness is felt in terms of an information deficit. This deficit can be in- 
ternal ,• external , or both. In other words, deciders can need to know more 
about the following: (a) what they really want or value personally; 
(b) what options are available to them; (c) what the specific natura of 
those' options might be; or (d) what the likelihood of success qr satisfac- 
tion might be (both in terms of personal interests and abilities and en- 
vironmental conditions) in pursuing any of the alternatives. 

It seems that at the very least competent CDM requires the ability to 
'recognize and specify personal work values and the information-processing 
skills necessary to acquire relevant data and evaluate realistic alterna- 
tives in light of those values or preferences. This position is similar to 
.Katz's (1966) suggestion to regard CDM as a strategy for acquiring and pro- 
cessing information. He posed three questions relevant to this discussion: 
(a) Do students know what information they need? (b) Can they get the in- 
formation they want? (c) Can they use the information they obtain? 

Katz's questions suggest closely related but , separate indexes of CDM 
competence. Such indexes, however defined, might have high positive corre- 
lations with^basic verbal reasoning, reading comprehension, or perhaps even 
analytic reasoning scores.' However, whether such correlations would result 
and how separate indexes of CDM would correlate for individuals in various 
instructional programs remain empirical questions. 

A major challenge facirig this" research project Ws^"^^^^^^ 
ful component scores for evaluating the quality of various aspects of a CDM 
performance. Katz's development of the Simulated Occupational Choice (SOC), 
instrument (1976, 1977, 1978) represents an important attempt to construct 
a diagnostic measure of multiple competencies in career decisionmaking.- 
However, a careful evaluation revealed that SOC failed to meet a number of 
important criteria deemed necessary for use in this research. . Most notably, 
SOC has severely limited face validity. Thus, it was necessary to devise a 
considerably more complex simulation with some of. the same scroring features 

1 ' ■ ■ 

-■! • . 

i' '■' •• Summary 

1 Vocational planning and sound career decisionmaking remain a top con- 
cern of students at many levels of public and private education. As the 
economy falters and employment opportunities diminish, the pressure to make 
good career decisions increases accordingly. Educators, guidance personnel ^ 
andj psychologists struggle to design constructive learning experiences that 
will facilitate the career development ly^oce^s. ' 
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Little is known about the nature of career decision-making procedures 
that lead to better outcomes. Few systematic decision training programs 
or models have, been rigorously evaluated. Progress has been limited by the 
lack of performance measures yielding outcome criteria useful in either 
program evaluation or differential diagnosis for particular skill 
competencies. 



METHOD 



Introduction 



This study was designed to investigate the effectiveness of a multi- 
component training program in career decisionmaking. A seven-unit curricu- 
lum advocating a "^sequence of planned decision-making actions was adminis- 
tered in four different classes to a random half of a sample of students 
at Mountain View High School in Mountain View, Calif. The experiment was 
primarily concerned With the effects of certain learning experiences on the 
use of a specified set of CDM ^behaviors . Thus, the major independent vari- 
able consisted of .the presence or absence of a CDM skills training program. 

A basic assumption of a social learning theory of CDM (see Krumboltz, 
197 9; Krumboltz & "Rude, 1980) is that decision-making skills are products 
of learning experiences and can be directly , modi fied through the applica-. 
tion of learning' principles. Although systematic attempts, have been made 
to help people develop CDM skills, hardly any research has been done to 
evaluate these interventions. The study reported here assessed the overall 
effects of providing modeling, positive reinforcement, guided practice, and 
appropriate resources in teaching rational model of CDM. The goal was to 
assess the impact of a comprehensive curriculum and to refine some instru- 
ments useful for both differential diagnosis and program evaluation';' 



This research par 



lially replicated a recent investigation (Krumboltz, 
Scherba, Hamel, Mitchell , \Rude , &,Kinnier, 1979) that tried to .answer the 
question, "Does teachiikg a rational approach to CDM improve the qOality of. 



career decisions?** Krumboltz et al. 



tested a 90-minute treatment based on 

Al- 



a systematic CDM process with a community college student population, 
though Krumboltz and^)hijs associates did not demonstrate the superiority of 
uheir decision training procedures overman attention-placebo condition, 
their experiment raisec^ a number of intriguing questions and suggested sev- 
eral goals for subseqaient research. 



Specific Objectives • 

The specific objec Lives of the study were as follows: 

1. Investigate whether a prescriptive, multicomponent CDM training 
program for high schpol students would produce these results: 



(a) Superior perEomiance scores on a simulated CDM problem; 



(b) Superior kriowledge^ s^^^ on' a s tandardized , cognitive measure 

of CDM prin^ciples \and facts; and 
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(c) Greater self-efficacy estimates' bf decision-making a'bility. 

Observe how self-efficacy estimates of decision-making ability 
correlate with CDM knowledge and performance scores. 

Observe how CDM performance, knowledge, and self-efficacy scores 
correlate with basic -academic achievement dada for the target 
population. 



Experimental Desipn. 

The design used was the randomized posttest-only control group- design 
described by Campbell and Stanley (1966) as one of the three "true" experi- 
mental desighs. Several modifications were made: (a) a stratified rather 
than a simple randomization procedure was used; (b) one set of dependent 
variables--self-efficacy estimates of decision-ntaking abilities-was as-' 
sussed both before and after treatment; and (e) grade point averages as 
well as mathematics and reading achievement scores from the Stanford Task 
Battery Analysis (all obtained pretreatment) wer.e used as covariates in 
computing the --.main effects and interactions of the design factots on sev- 
eral dependent variables. 

_ The other dependent' variables , assessed after the treatment, were cri- 
terion measures of the following: (a) knowledge about the facts, princi- 
ples, and applications of rational decisionmaking; and (b) ability to per- 
form in a simulated career decision situation. The independent variable 
was the presence or absence of a seven-unit CDM training program. Training 
took place at Mountain View High Schpol in four different classes of eight 
students each, randomly assigned (after stratifying by seic) from volunteers 
in four different third- and fourth-year English classes. The four instruc- 
. tors responsible for the CDM training had no contact with the students as- 
signed as matched no-treatment control groups. 

Participant Population 

This research was motivated by a concern about the inadequacy of ef- 
forts to assess the impact of career education programs in the nation's 
^nM^^L^""-^""^^- '"^^^"'^e the effects of a program designed to improve 

CDM efficacy, a population of older- high school students (mostly juniors) 
was selected for several reasons. - ' 

First, these individuals have almost reached the end of a public 
.•schooling experience and have. been exposed to whatever range of career 
education programs are offered within their school system. Such students 
should be prepared, to integrate a number of career development concepts 
•that culminate in the learning and application of CDM skills. 

Second, older high school adolescents seem particularly concerned 
with exploring the personal values that are so vital in all kinds of 
decisionmaking. Developmentally , these youngsters are dealing with cru- 
-xial..experieaces-that shape att-it-udeS7-bei-ie*S7-^n-d-behaviors regarding 
gender roles; ways of relating to others; future aspirations; and 



31 16 



convictions about values, work, leisure,, and many other things. In short, 
they have reached a decision-making readiness s.tage in their lives. 

Finally, the last years of high school present an inevitable choice 
point — one of many they will face. Personal, educational, and vocational 
decisions made here (either l^y choice or default) have important conse- 
quences,, Therefore, high school juniors and seniors represent both a prac- 
tical and a clinically compelling population for assessing the effects of 
a decision training program. It was hoped that such a population would be 
especially receptive to efforts aimed at. improving decision-making competence, 

8 

Samplin_g Procedure 

Participants were obtained primarily from third-year English classes 
(with a few sophomores and seniors added) for the following reasons: 
(a) ease of access to the desired population (besides physical education, 
English is tiie only subject in which all juniors and seniors are enrolled); 
and (b) the str6ng suggestion from the school's administrators that English 
department faculty would he the most likely to support the study. 

Students were recruited by visiting their classrooms, expla^ining the 
program, and asking, for voluntary participation. Both administrators and 
faculty advised against conducting the CDM classes either before or after 
regular school hours. The teachers granted permission for stiidents assigaed 
to the treatment condition to attend the CDM classes once per week for 7 weeks 
in place of their regular English classes without suffering any penalties. 
This attitude of cooperation and accommodation was no doubt crucial in suc- 
cessfully recr-iiting students. 

• Five English teachers allowed .recruitment frpm their classrooms. Only 
third- and fourth-year English classes with enrollments of at Teast eight 
male and eight female students were visited. The goal was to treat each 
classroom as ,a separate sampling pool and, after stratifying by sex, ran- 
domly assign four males to a treatment group, four to a matched no-Lreatment 
control condition, and any remaining malfe volunteers' to a reserve pool. 
The same random assignment procedure was used for female volunteers. 

An experimenter was introduced in five different classes who spent 
about 15 minutes explaining the purpose and content of the CDM training 
program. The experimenter also explained how volunteers would be assigned 
to the classes and that all volunteers, regardless of group assignment, 
would be asked to complete some instruments' measuring their CDM attitudes, 
■ knowledge, and ability. After answering questions, students were -asked to 
complete a consent form (Appendix A) indicating their interest in ,the pro- 
gram, &nly inte**ested students comprised the population of this study. 

Table 1 summarizes the number of students in each participating class 
whb^ indicated interest in taking parE in the study. Only junior students 
were enrolled in Class 1 and Class 2, while Class 3 and Class 5 consisted 
entirely of seniors. Class 4 consisted primarily of juniors and a few 
advanced sophoinores, A total of seven sophomore volunteers from Class 4 
participated In the study. The total sample of students consisted of 17 
seniors-, 40 juniors, and 7 sophomores. 
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Table 1 



SuiMiiary of the Number of Interested and .Noninterested Students 
in the Five Participating Classes 



H 

CO 



0". 



English 
Class 



Teacher Gender 
Course Name 
Period 



Number Percentage 

Number of Students of Students Total , of Students 

Indicating Interest Indicating Number of Indicating ' 

,Total Males Females 'No' Interest Students Interest 



V ; 


Male //I 
English IIIC 
Period 1 


17" 


10 ' 


7 


5 


22 


11-31 


2 


Female #1 
English IIIC 
Period 3 


13 


4 


V ■ 


12' 


25 


52.0 


.3 


Female //2 ■ 
English IVC . 
Period 3 


■17 


10 


7 


1 


18 


; 94.4 


4 . 


Female /'3 
■ Orientation to College 
(Sophomores and Juniors) 
Period 4 


20 


- 11 


9 


7 ■ 


21 


. 7^.1 


5 


Male \\1 , 

English iV-College Prep 
Period 5 




1 


3 


11 


15 


26:7 


Total 




71 ^ 


36 


35 


36 


107 


■ H 



I-' 



ERIC 



Assignment: of Participants to Treatment Conditions 

As mentioned above, the goal was to obtain one experimental and 'one 
control group, balanced by sex, from each classroom. • There were good 
reasons for this goal. First and most importantly , there was a practical- 
scheduling need. If students from different English classes meeting 'dur- 
ing, different periods were combined to form a CDM class, then some of 
these students would he missing a class other than English, and special 
permission would be needed. Second, assigning students to a treatment 
group from an intact class had the advantage of building on existing 
familiarity, tjiereby reducing- the amount of time needed to get acquainted 
and to be comfortable working together. ; * 

After collecting the consent forms in each class, the forms were sep- 
arated by sex and numbered. Using. a table of random numbers (Robbins & 
Van Ryzin, 1975), students were assignjed to either a treatment or control 
group. Table 1 shows that assignment by simple stratified' randomization 
within each class was not possible because not every class yielded' a suf- 
ficient number of male and female volunteers. 

For example. Class 4 yielded a gender-balanced control and experimental 
group, plus one extra female and three extra males who were placed in 
separate male and female reserve pools. Since Class 2 yielded an insuf- 
ficient number of male students, and Class 3 yielded an insufficient number 
of female volunteers to stratiiify aiid randomly assign from each class sepa- 
rately, the two classes were combined and treated ^as a single pool. Two 
treatment "and two control gr^^ups vfere randomly assigned from this pool, 
after two. additional male students xjere randomly assigned from the male 
reserve pool, bringing the total' to 32 ^ with 16 males and 16 females. 
Class 1 produced two ext**£ male volunueers (assigned .to the reserve pool) 
and a deficit of ont fenale.^ Since there.. was exactly one participant in • 
the reserve pool for f-^inale -students , "she was assigned to the Class 1 pool 
before' randomly assie^iiing subjects to a treatment and control group. 

The above assignment procedure created four treatment and four con- 
trol groups of eight students each, approximately balanced by sex, yield- 
ing a'totsl of 64 (see Figure 1). However, since random assignment was 
done by iising the consent forms, one male was mistakenly identified as a 
female --due to a misreading of his name — so that the total sample con- 
sisted of 31 females and 33 males. 

The total reserve pools of five males and one female were created 
before subjects were rakidomly assigned to classroom pools for subsequent 
random 'assignment to. either a treatment or control group. "This procedure 
left three males in a reserve pool to replace any control males lost 
through attrition. One such subject was actually used to replace a con- 
trol subject who moved out of the school district before the pos ttreatment 
measures were administered. 

Finally, none of the four volunteers from Class 5 participated in the 
study. These students would have been assigned to their respective re- 
serve pools, but the instructor expressed a preference that these few 
students not be used unless absolutely necessary. Enough students were 
;recruited from 'other classes to make their participation unnecessary. 




Class • 


1 


2 


3 


4 , 1 


Treatments 


Group 1 
Instructor 1 


Groijp 2 
Instructor 2 


Group 3 
Instructor 3 


Group 4 
Instructor 4 






M F 


M • F . 


— ^ 

M F 


M F' 




CDM Training 


4 4 


4 4 


4 4 


4 4 


32 




Group 5 
No Instructor 


Group 6 
No Instructor 


Group 7 
No Instructor 


Group 5 
No Instructor 






M F 


M F ' 


M F 


M F 




No Treatment 
Controls 


4 4 * 

— : \ 


4 4 


,5 - 3 ... 


4 4 ' 


32 



16 



16 



16 



16 



L 



64 



N Males 
Females 
Total N 



33 
31 
64 



Figure 1. 



Randomization design: assignment of students to treatment grouos 
Mountain View High School. ^- ^' 
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Table 2 sununarizes the number of male and female students contributed by 
each participating English class, based on the random assignment procedure 
described on the preceding page. , ^ " . 

Table 2 

Totdl Number of Students Contributed-by Each 
Participating English Class * 



Treatment Condition 

^ • . ^ Experiirientals Controls 

English^ Class Males ^ Females Males Females Total 



3 . 16 

4 . 13 
3 16 
3 19 

15 64 



Design Factors 

Table 3 provides a comprehensive breakdown of the composition of each 
of the eight assigned groups by sex- and English , class of origin. From this 
table it is clear that the 2x2x4 design has two levels each for the sex 
of subjects and treatment condition factors . The third factor-is somewhat 
less clear-cut. 

- Table 3 reveals that the control and experimental groups are roughly 
matched in terms of the three separate sampling pools from which they were 
rcindomly assigned. For instance, all experimentals and matched controls in 
Groups 4 and 8 were recruited from the same classroom. The same can be' 
said about Groups 1 and 5 except for one control subject. Groups 2, 3, 6, 
and 7 were all assigned from the same sampling pool (combined Classes 2 and 
3). Groups 2 and 6 and groups 3 and 7 are matched with the exception of 
one-subject in control "Group 7 and two subjects in control. Group 6 . 

The instructor variable was deliberately confounded with the class of 
origin variable because there was no psychological ^interest in the main ef- 
fects of either variable. This combined variable constitutes the third fac- 
tor, class/instructor, with four levels for each of the matched experimental 
and control groups . In other words , level one represents Groups 1 and 5; 
level two. Groups 2 and 6; and so on. Any main effects for class/instructor 
might be due to . the influence of the instructor, the class(es) from which 
.sXudents were recruited, or possibly some--interaction-between^he -dLnstTuctor 
and the class of origin variables. Thus, the 2x2x4 design used in this 
study reflects two levels each for the treatment condition and sex of sub- 
jects and four levels for the combined class of origin and instructor fac- * 
tor abbreviated class/instructor. 
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Table 3 



Number of Participants by Sex and Class of Origin 
for Experimental and Control Groups 



Experiraentals 






Controls 




Group 


Males 


Females 


Class 


Group 


Males 


Females 




Class 


Group 1 


4 . 


4 


1 


Group 5 


4 


3 


. 1 


(Instructor 1) 












1 


4 


Group 2 


1 


2 


2 


Group 6 


X 




1 


(Instructor 2) 


3 


2 


3 






2 


2 


Group 3 










2 


2 


3 


• 2 


2 


. 2 




1 - 




'4 . 


(Instructor 3) 


2 


2 ■ 


3 










Group 4 








Group 7 


2 


2 


2 


4 


4 


4- 


2 


1 


. 3 


(Instructor 4) 










1 




4 










Group 8 


4 


4 


4 


Total 


16 


16 




Total 


17 


15 





Instructors • 

The four instructors who aciministered the CDM skills training program 
were students at Stanford University. Table 4 provides relevant information 
.on their backgrounds. ' | 

All instructors pa'lrticipated in the design and planning of the "instruc- 
tional curriculum. For several months prior to the beginning of instruction 
and throughout the training program, weekly planning meetings were held to 
discuss and rehearse the training activities and exercises. These sessions 
insured both a Q^ertain amount of instructor practice and preparation and 
reasonable uniformity in delivery* of the treatment. 



Experimental Treatment 

This experiment was concerned with the effects of certain learning ex- 
periences on the use of a specified set of CDM behaviors. The major inde- 
pendent variable consisted of the presence or absence of a training^ program 
on decision-making skills. The program involved seven weekly meetings of • 
.about^X^hour-eaGh:>-plji_%::a3V model 
taught was that when a decision situation occurs, it is often helpful to 
approach it in a sequential series of steps that will enable the decider to 
reduce the levels of complexity and ambiguity and deal with the decision 
in an orderly fashion. 
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Table 4 * 

Information About CDM Skills Training Program Instructors 



■ English Class(es) 
Instructor Students Assigned From Sex Age 



Education 



Previous Secondary School 
Counseling Experience ' ^ 



Class 1 English IIIC F 
Period 1 

Class 2 English, IIIC .M 
+ 

Class 3 English IVC 
Period' "3 

Class 2 English IIIC ■ M" 

Class 3 English IVC 
Period 3 . 

Class 4 Orientation to M 
" College 
Period 4 



21 \ College Senior 
Psychology Major 

30 2nd yr.. Ph.D. Candidate 
Counseling Psychology 



32 4th yr. Ph.D. Candidate 
.Counseling Psychology 



28 •3rd yr. Ph.D. Candidate 
Counseling Psychology 



None 



None 



3 years 



l^year 



The DECIDE S Model 

■ • ■;' -s- . • ■. . 

\.ir^J^^ conceptual model prescribing steps to be followed in CDM situa- 
txons -evolved from an earlier strategy defined by Krumboltz and Baker (1973) 

. b"nd^H:mer^^^^^^^^ ^^^^ ^^^^^^^^ — 

Define the^problem . Students were' taught how to recognize' that 
bv wM^W '° a problem in terms of some specific date • 

llu^^l .^-decision must be reached. Emotional influences on decision- 

makxng were considered at this first stage and. at all subsequent phases o^ 
n^te rSx^nf- . f^''"^ Planning for the future and procrLtx- 

TiT.r . ■ '° ""^^^ decisions. Others find it painful to even con- 

sxder elxmxnatxng some options from further consideration-they fear some 
eventual regret over whaf they might be giving up. -Students were urged to 
rSr^' "'T P^°bl^'"^ and- encouraged to set .a date by which a dLis^on 
must be^made. Resistance .to the process of decisionmaking is at least par- 
confWently^° ari. absence of knowledge ■ about ways to do it efficiently and 

- ^.f- Establish . an action^ plan . - Students were taught that the importance 
effort to"rT'r.°' " '""^^'^ determines, the amount of time and., 

hf °n^- ""^^^""^ decision. .Important decisions that can 

be antxcxpated xn advance deserve greater resource allocations than do mjnor 
decxsxons or decxsxons that must be made within a short time. Learning to 
dxscrxmxnate^ those decisions with. potentially important repercussions L ' 
almost a skxll xn its bwn right. Students were shown how to budget time 
and resources for each of the decision steps relevant to a variety of choices 
they were .currently making. The plans they made to accomplish the decision 
?tndpnt.T' 'Tt^'"^ a tentative guide for action, not a final commitment. 
Students learned how to set reasonable deadl^ines for completion of each step 
xn thexr plans and were^ given .the expectation that a series of steps ' of tfen 
needs to he recycled several times in order to arrive at a satisfactory ' 
fxnal determination. ■,' 

3. Clarify values. Students were taught that : their own personal val- 
ues provxde^ the criteria. by which they can'^udge the possible alternatives 
under consxderatxon. A problem can be decided to the satisfaction of the 
decxder best yhen that decider's values have been thoughtfully examined and 
clearly. stated. Ways of discovering values were described and modeled, and 
experiences were' provided for students to help them discover their own val- 
ues ^through varxous expl6ratory and record-keeping activities. Students ' 
were asked to write a summary of their most important values and' led to re- 
call experxences- that indicated the types of evenCs that create an awareness 
of values or cause values to change. .. Instructors pointed but that each • 
s.tudent s values, having changed in the past, may also change in the future ^ 
xn (inpredxctable.ways. It was emphasized that for most major decisions no ' 
sxngle alternative can be expected to satisfy. all values. Students were 
taught how to rank v^alues in order^of importance and make compromises that 
maxxmize attainment of their highest priorities. /Exploring benefits (and ' 
costs) experienced from prior decision situations often leads to the 
coverxng of previously unrecognized values. ~ 
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: 4. Identify alternatives . Students were taught to anticipate that -.^^ 
►re than two alternatives exist In almost every decision-making situation, 
variety of resources can be used to generate additional options, and stu- 
tnts-..were ^ given the opportunity to become familiar with some of these re- 
mrces, particularly those available in a Career Resource Center. Exer- 
.siBs were provided in which students generated creative alternatives to 
icision-making problems. Again, to emphasize the necessary flexibility 
: the model, it was pointed out that value preferences are often realized 
ille searching for alternatives. 

5. Discover probable, outcomes . Students were taught that the values 
ated in Step 3 can be transformed into questions useful for' evaluating 
•tions generated in Step 4. Finding the answers to these questions is 

le purpose of Step 5. In. essence, students vxere taught how to evaluate 
le likelihood that each of their important values would be realized through 
Lch alternative under consideration. Instruction was provided in acquiring 
id evaluating relevant information. Emphasis was placed on judging indi- 
.dual abilities and interests relative to "those characteristics of people 
esently engaged in career options that seemed attractive. Students were 
.ught to recognize biased and inaccurate information and to estimate prob- 
'le future occurrences in the career marketplace. Deciaions are nearly 
ways made under conditions of uncertainty, but ways of reducing the de- 
ee of uncertainty represent a skill that can be learned. 

6. Eliminate alternatives systematically . Students were taught that 
eve are^various ways of arriving at optimum decision alternatives. Some 
'ssibllities include the following: (a) eliminating least desirable al- 
irnatives one by one until the remaining alternative constitutes the terita- 
.ve choice; (b) selecting two or three of the most promising and feasible 
.ternatives for intensive study; or (c) assigning importance weights to • 
:rsonal values and subjective probability estimates to each alternative 
istiihated likelihood that the alternative can or will be realized), so that 
te sum of weight X probability . products for each alternative provides a 
lantitative estimate of its relative attractiveness. Individuals were en- 
luraged to adopt the particular strategy that works best for them in a 

.ven situation. The problem of making risky decisions was considered, 
d students were taught that the alternative having the greatest chance 
success is not necessarily the one they may wish to choose. Fallback 
ans can and should be developed in case the first choice alternative does 
tt succeed. An attitude of healthy skepticism about future predictions 
.s encouraged. Finally, it was_ pointed out that when alternatives cannot ♦ 
: eliminated on the basis of currently stated values and information, either 
her values need to be considered, additional information needs to be col- 
:Cted, or the alternatives are in fact equal. 

' 7. Start action . Students were taught that a decision is more than 
cerebral operation — deciders must put the decision into action. Decisions 
e not truly made until they are implemented ... .Emphasis was. placed on ac- 
:pting responsibility for the consequences of acting on decisions. Ideally, 
lese seven steps could be generalized and applied to many kinds of decisions 
lat students in the target population typically make. 

The initial letters of each step of this seven-step procedure combine 
I spell DECIDES, a useful acronym to help students remember the sequence 
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of actions. Throughout, the training period, however, students were advised- 
to^aypid a rigid adherence to the prescribed sequence of steps in the mpdel, 
ov^o!;!^- "^^I ^ personally meaningful procedure for making decisions 

systeniatically. See Appendix C, Student's Workbook, for brief operational 
ae£in:!.tions and concrete examples of each of the DECIDES steps. ' 

Treatment Features . 

Behavioral objectives and lesson units for a multicomponent curriculum 
?nM ^-^^^ the DECIDES strategy were developed. The general format for the 
CDM skills training included a combination of ' (a) didactic explanations of 
the concepts being taught, (b) demonstrations of how the skills can be ap- 
^ . "^-^ ^^^^ situations, (c) guided practice on simulated problems, - 

and (d) opportunities to perform the skills independently. This last com- 
ponent IS probably the most crucial, and emphasis was placed on identifying 
important decisions of current relevance for practicing decision skills 
training, i . . 

Instructors used modeling and positive reinforcement techniques and 
provided resources in accordance with Propositions IIAl, IIA2, and IIA3 of 
the Krumboltz (1979) social learning theory of CDM (see Appendix B) but 
made no attempt to analyze the differential effects of particular treatment 
components at this time. The goal was to discover whether an overall ef- 
fect could be demonstrated before attempting to isolate the contributions ' 
or separate . components . . ' 

_ A variety of structured exercises and assigned activities was included 
in a student s workbook (see Appendix.C) to supplement the group instruction. 
nFrJnpt ^ number of existing programs were adapted to meet the 

DECIDES model guidelines. Materials were developed.based on programs devised • 
ay Hamel and Davison (1974); Ferguson (1976); and Gelatt, Varenhorst, Carey, 
and Miller (1972). Major topics, not necessarily in sequence ,. included recog- 
iizing and anticipating significant decision situations through , discriminationV 
training, clarifying values and conducting self-assessment, identifying and \ 
jsing worthwhile informational resources, using objective data and subiec- \ 
live impressions to evaluate possible options, exploring a reduced set of 
attractive alternatives firsthand, changing inaccurate self -attributions 
ind occupational stereotypes, and restructuring the personal environment 
:o increase the likelihood of engaging in desired decision-making behaviors. 

.esson Unit Summaries ' 

.Investigators prepared structured and detailed lesson plans (see Ap- 
pendix D) for each of the seven training sessions. The following brief sum- • - 
provide an ove rview of th e exp erimental treat ment. 



Session .1 . The three objectives of the first meeting were to (a)' make 
ntroductions and get acquainted, (b) distribute workbooks "and provide an 
verview of the program, and (c) introduce the DECIDES model-. An icebreaker 
xercise was used to get students acquainted and to suggest the possibility 
f lea»-ning through shared experiences." The instructors reviewed the program 
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md the model and encouraged students to come up with a major decision to 
^ork on throughout the program. Emphasis was placed on identifying problem 
situations and distinguishing important decisions. 

Session. 2 . The objectives of this session were to (a) review homework 
ixercises, (b) see that each student had an appropriate major decision to 
7ork on, (c) "provide guided practice with^the DECIDES model by involving 
:he group in a fictitious checking account decision, (d). give students prac- 
:ice in formulating problem definitions, and (e) review Step 1 of the model. 

The guided practice of choosing a bank at which to open a checking ac~ 
lount allowed students to experiment with each of the steps of the model and 
:o see the model used in actually making a decision. 

Session 3 . The primary objective of this lesson was to introduce an 
iction plan for decisionmaking. The class was divided into pairs who helped 
)he another set up an action plan for their major decisions, allowing the 
Instructor to circulate and provide individual attention. As with each of 
:he preceding -sessions ,-homework- was assigned to- tie up- topics covered in 
:lass and prepare for the next session. 

Session 4 * The objectives of this session were to (a)_ heli^/students 
inderstand the concept of values and how values affect our/llves^, _ (b) pro- 
vide an exercise to help students begin clarifying their own values .aind 
recognize strategies for doing so, (c) enable students to see the influence 
)f values on the decision-making process, and (d) have students participate 
.n a forced-choice structured exercise in which they must not only. -make some 
lecisions as a group member but must also communicate and even defend their ~ 
)referencss to other- group members. 

Students were introduced to the concept of work values. Discussion 
;as focused on various work values and activities to engage in to understand 
)r clarify those values. The class was then divided into two groups to par- 
:icipate in the- Fall-out Shelter values clarification exercise (see Appendix 
0 • For homework, students were asked to interview spmeone they admire to 
:ind out what is important to that individual in his or her work. 

Session 5 . This session was ..used as an orientation to the school's 
Career Planning Center. This orientation was- conducted primarily as a 
leans of helping students identify and use relevant information sources, 
lie Career Planning Center at Mountain View High -.School has an excellent 
:omputerized information search system, with files on colleges, financial 
lid, and careers. Students were encouraged to make use of all relevant 
ind available information there and to become familiar with the computer's 
:apabilities . 

Session 6 . The objectives of the sixth lesson were to (a) introduce 
:he grid system, an organizational heuristic for systematically comparing 
ilternatives by gathering information about personal values; (b) offer 
;uided practice with the grid system on a fictitious student's summer job 
lecision; (c) familiarize students with Step 5 of the model; and (d) intro- 
luce an occupational experience exercise wherein students could apply CDM 
ikills in selecting one of 20 part-time jobs. 
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The organizational grid is potentially' one of the most helpful guides 
for decisionmaking; therefore, considerable^ time was spent allowing stu- 
. dents to both familiarize themselves with the grid and practice using it 
independently, particularly on their personal major decisions. There was 
not sufficient time to introduce the occupational experience exercise. 

" 'l^ , . 

Session 7 . Much class time was spent on administrative matters: ad- 
ministration of the Check List of Decision-Making Ability, class evaluation, 
handing in workbooks , .and so forth. In addition, instructors attempted to 
sum up and provide closure on the DECIDES model of career decisionmaking. 
Students were asked to share any tentative solutions to their major de- 
cision problems and give their impressions about the usefulness of apply- 
ing the model to their particular problems. 



Instruments " 

Three criterion measures were used to assess the ef fectdveness of the 
CDM skills treatment. The Check List of Decision-Making Ability (CLDMA) , 
administered before and after training, measures attitudes and feelings * 
about an individual's ability to perform certain decision behaviors and 
provides data from the affective domain. The Career Decision-Making Skills 
Assessment Exercise (CDMSAE) measures knowledge of facts and procedures • 
relevant to CDM and is therefore a cognitive instrument. Performance do- 
main data were generated by the Career Decision Simulation . (CDS) , an instru- 
ment that assesses how well a person performs a simulated decision task. 



Check List of Decision-Making Ability (CLDMA) 

The CLDMA is a self-rating form adapted (and greatly modified) from 
an instrument reported by Ferguson (1976). It consists of eight items, ask- 
ing users to estimate their ability, compared^ with the average person of 
their age, to perform certain decision-making behaviors. Estimates are 
made using scales of 1 (poor) to 9 (excellent). The first seven items e^ch 
correspond to one of the seven steps or actions represented by the pre- 
viously described DECIDES model. The eighth item relates to ability .to be 
flexible and recycle ^through the various CDM steps and asks people to esti- 
mate how well they are able to reconsider a decision when none of the 
present alternatives seems acceptable. Below each item- on the CLDMA is a 
concrete example of, the decision-making behavior represented by that item 
(see Appendix E) . 

The CLDMA was designed to elicit^ self-ef f'icacy estimates of CDM ability. 
The concept of self-efficacy is an important element in the social learning 
theory analysis of CDM. Bandura (1977) has discussed extensively the notion 
of self-efficacy and its relation to performance. Although most of his re- 
search has focus ed on ch anging fearf ul,lav-Oi H;^n^ Ki:>hAA74ar— (-s ee--Ban dura, 
Blanchard, & Ritter, 1969; Bandura, Jeffrey, & Gajdos', 1975; Bandura, Adams, 
& Beyer, 1977), Bandura's work is relevant here. 

According to Bandura, efficacy expectations are presumed to affect the 
level of performance on a. given task by influencing the intensity and per- 
sistence of effort. He contends that psychologi^.al procedures can serve to 
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sate and strengthen personal efficacy expectations. His use of various 
rticipating 'modeling techniques has proven dramatically 'effective with 
ake phobics, 

*» " ' 

Bandura makes a distinction between outcome and efficacy expectations 
ae Figure 2) relevant to this study,. Outcome expectations are estimates 
at performing a certain behavior will, lead to a desired outcome. Effi- 
gy expectations, though, are beliefs that one can successfully execute 
2 behavior required to produce the outcome. Thus, expectations of self- 
ficacy, because they come before the actual behavior, affect both the 
Ltiation and persistence of -that behavior (Bandura, 1977), Accordingly, 
Dple tend to involVe themselves in activities, they think they can handle. 

Person > Behavior ^ Outcome 

. r r 

Efficacy . Outcome 

Expectations ' Expectations 

Figure 2. Outcome and efficacy expectations (after Bandura , 1977) , 

Although self-efficacy estimates have been shown to be powerful pre- 
:tors of actual ability in a number of performance areas , no research has 
Lated self-efficacy estimates of CDM ability to actual performance. The 
)MA was constructed to meet this need and also to assess how focused 
lining in CDM might affect self-efficacy estimates of CDM ability. 

Finally, the CLDMA can also be construed as an instrument that ad- 
isses several of the key components of the Krumboltz (1979) social learn- 
I theory of career selection. In effect, the Check List items ask re- 
mdents to make self-observation generalizations (SOGs) based on previous 
irning experiences about their ability to perform certain task- approach 
Ills (TASs) , Krumboltz defines a SOG as an "overt or covert self- 
itement evaluating one's own actual or vicarious performance in relation 
learned standards" (Krumboltz, 1976), He defines TASs as "cognitive 
1 performance abilities and emotional predispositions for coping with the 
^ironment, interpreting it in relation to self-observation generalizations, 
1 making overt or covert predictions about* future events. TASs include 
. , skills in value clarifying, goal jetting , , , alternative generat- 
; , , , eliminating and selecting alternatives, planning, and generaliz- 
5" (Krumboltz, 1976), In other words, the CLDMA asks its users to make 
we metric SOGs about their ability to perform some specified CDM task- 
>roach skills. 

Whether we refer to the underlying psychological concept as self- 
ficacy estimates or self-observation generalizations is fairly unimpor- 
it. What does matter is how such CLDMA 'estimates relate to a performance 
isure and how- such estimates are influenced by a .CDM training intervention. 
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Career Decision-Making Skills -Assessment Exercise (CDMSAE) 



The College Board's CDMSAE of the Career Skills Assessment Program 
(1977) consists of 60 multiple-choice questions. The items are designed 
.to measure the extent to which individuals can identify the facts, prin- 
ciples, and applications of rational decisionmaking. Situations described 
in the exercises "suggest that career decisionmaking is an ongoing process 
that choices are reversible,- and that Ganges in a person's circumstances 
or values may bring about the need for new decisions" (The College Board, 
1976), The CDMSAE provided an objective measure of knowledge about effec- 
tive decision-making procedures. 

Item specifications for the particular abilities and objectives that 
serve as the basis for the CDMSAE are categorized under the steps of the 
DECIDES model. Grouping items by discrete categories permits the genera- 
tion of seven subscores that are useful both for differential diagnosis • 
and for program evaluation,' Also, the use of the DECIDES -system as an 
organizational construct for the CDMSAE" provides researchers with a con- 
venient, theory-based conceptual framework for interpreting data gathered ' 
in evaluation studies. 



Readers are referred to the Career Decision-Making Skills Exercise 
^QQ^l^^ (The College Board, 1977) for a look at the items comprising the 
CDMSAE, and the Guide to Career Decision-Making Skills (Krumboltz & Hamel, 
1977) for the item explanations. It should be noted that the CDMSAE was 
piloted extensively, by the College Board's five-state (Georgia, Maryland, 
Minnesota, New Jersey, and Ohio) Career Education Consortium, The coopera- 
tion of state education agencies in these five states enabled the exercise 
to be administered to a large and representative sample' of students in 
grades 10, 11, and 12 — the same population used in the study reported here. 
Statistical characteristics of the CDMSAE, including score precision, item' 
analysis, speededness, and validation, are covered in depth in Part B: 
Technical and Other Considerations, of Implementing the Career Skills As- 
sessment Program (The College Board, 1978), 

Career Decision Simulation (CDS) 

A major challenge facing educational researchers is developing a 
jneans to assess the quality of career decisions. Although psychologists 
make frequent reference to the desirability of an objective criterion for 
successful career decisionmaking, no such measure is available. This 
project's goal was to create an analog device that would capture as many 
of the complex dimensions of CDM as possible and also yield objective 
measures of CDM efficacy. 

A simulation device was needed that would meet the following 
specifications: 

' 1. Provide an objective, standardized procedure for assigning a nu- 
merical value to the outcome of a participant's job decision — a 
degree of goodness score; 
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Represent real-life CDM as closely as possible — high face 
validity ; . ' 



3. .Deal with a variety of personal work values dimensions; 

4. Provide a recording syst^em to track a person's decision-making . 
behavior — both record and preserve the cumulative;; sequential 
information on how the simulation was used; 

5. Be noncompetitive and compatible with independent use — require 
only one person's participation at a time; ' 

6. Be reasonable to complete within a 90-minute time limit;* 

7. Be self-contained; and 

8. Be stimulating, easily understood, and unbiased with regard to 
age, race, or sex. 

Although both the Life Career Game (Boocock, 1967) and SOC (Katz, 1976) 
contained features attractive for this research project, neither simulation 
adequately met the above specifications. Thus, it became necessary to de- 
sign and construct an appropriate device. 

The Career Decision Simulation (CDS) is the criterion instrument de- 
veloped to measjLire CDM behavior. It is a second-generation simulation of 
a CDM problem, modified from a previous study (Krumboltz et al,, 1979) to 
enhance"* its face validity and make it morfe sensitive to various ways of 
searching, using, and recording information about occupations. The prin- 
cipal change involved elimination of devices called job strips that inad-. 
vertently taught a rational approach to using the simulation as well as 
provided a handy and unrealistic recording system. The CDS not only pro- 
vides a standardized procedure .for assessing the quality of a career de- 
cision through the use of objective, numerical scoring systems > but it also 
provides data to make inferences about a person's decision-making style • 
Thus, users can gather information about both '^decision-making proces'ses 
and outcomes and see how these data correlate for individuals * with varying 
decision-making predispositions who have been exposed to different instruc- 
tional treatments. 

The Cbs's basic rationale is that good decision makers interpret in- 
formation, accurately and are able to make decisions that yield consequences 
consistent with their own values. Participants' are allowed' up to 90 min- 
utes to pick one of 12 fictitious occupations that most nearly satisfies 
their values. Some 333 separate bits of information organized into 10 dif- 
ferent information sources are available on cards or aiidio tapes* The in- 
formation was designed so that for each of 1,680 possible value preference 
configurations generated by a forced values rating task, the goodness rank 
order of the simulation's 12 fictitious occupations can be quickly, determined. 

Participants could adopt any particular type of decision style and 
still be able to make a good choice. They could exclusively or fatalistically 
choose their preferred occupation immediately without surveying any of the 
occupational information, or they could spend up to 90 minutes searching 
and thinking, ' \ 
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In its previous form, the CDS yielded only a single measure of CDM 
competence (Krumboltz et al., 1979). This criterion might be called val- ' 
ues congruence— selecting an alternative that' maximizes personal values. 
A major goal of the present study was to modify the CDS scoring procedure 
to yield additional and equally valid indexes of CDM competence. These 
other performance criteria are (a) accuracy in interpreting information 
relevant to an occupational choice, (b) thoroughness of information search 
on most highly prized, values , (c) an additional values congruence score 
based on a forced choice rating task administered about a month before • ' 
participants used the CDS, and (d) self-tested confidence in the goodness 
of the decision. 

The rationale for the accuracy score is that good decision makers in- 
terpret the information they use correctly and 'use some system for remem- 
bering or recording their observations about alternatives when necessary. 
The score is derived from the value level ratings participants assign to 
a set of nine work values on the Job' Rating Form (see Appendix G) for the 
occupation they have chosen. Since all 12 of the CDS's occupations have ' 
been assigned real value level ratings (as reflected by their descriptions 
on information units) the score is based on the. extent to which partici- 
pants ratings match the assigned or intended . ones . Accuracy scores can 
range from 10 to 85, with 85 representing perfect accuracy. That is, those 
scoring 85 were able to assign the intended value level ratings to all-nine 
of the values for their chosen. occupation. The computational procedure 
and actual scale used are explained in Appendix G, the CDS Administrator's 
Manual. „ ■ ■ 

The thoroughness of information search score is not a totally inde- 
pendent criterion, since it potentially influences both the accuracy and 
values congruence scores. However, the rationale for a . thoroughness score 
as an index of CDM competence is compelling and practical. it makes sense 
to spend the greatest amount of t?ime and effort' in gathering information 
about those aspects (work values) of a job setting a person rates as most 
important. , A forced values rating task administered immediately after 
participants choose an occupation requires them .to rate three values as 
being most important to them. The thoroughness score reflects what -per- 
centage of all information units used during a CDS performance provides 
job information related to their three most important values. Scores 
range from aero to 100, with 100 indicating that- all the information sought 
was relevant to their three high values. 

The values congruence scores are based on the degree of fit between 
the assigned work 'value levels of the chosen occupation and forced choice 
work value ratings .reported at two different times. As mentioned, the 
rationale here is that good decision makers choose alternatives consistent 
with their expressed value preferences. An additional assumption of the 
scoring system (see Appendix G) is that it is most important to match high 
values, somewhat less important to match medium values, and least crucial 
to match lowest rated values. 

A Time 1 paper-and-pencil values rating task was administered about a 
month before subjects used the CDS. The Time 2 rating task occurred, im- " 
mediately after choosing a CDS occupation and was identical except for the 
use of a wooden form and pegs instead of paper and pencil. 
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: Thus, two different values congruence scores were "generated, for each" 
participant, allowing possible inferences about the utility of value pref- 
erences, and the influence of a recent choice on value preferences — 
rationalizing an occupational choice by rating, work values in a way con- 
sistent with the occupation's perceived characteristics. The scoring sys- 
tem for translating ,the degree of fit between the assigned work values of 
an occupation and a participant 's value preferences is contained in Ap- 
pendix G. This scoring system produces raw scores that are then transforme 
to rank order . of goodness scores to indicate how close students came to 
choosing the occupation most similar to their value preferences (12 = best • 
possible choice, and 1 = worst possible choice of all available 
alternatives) • 

The confidence score is based on participants' jud^ents as to how 
likely their chosen occupation represents the best one formed among the 
12 available. They rate their confidence on a scale of 1 to 10 (10 = very' 
confident) immediately after choosing an occupation. It was assumed that 
better decision makers would express more confidence in the goodness of 
their choices.^ 

In the descriptions that follow, the reader will^find it useful toV 
?efer to- Appendix F, Directions for the Career Decision Simulation, a \ 
transcript of the Directions tape for students, and Appendix G, the Career 
Decision Simulation Administrator's Manual; To use the sim^ulation, players 
begin by reading a diriections card labeled "Start Here," which acquaints! 
them with their purpose and directs them to listen to further orientation 
and instructions on the Directions tape. The "Start Here" card is repro/ 
ducsd below. ' 1 ' 



■ START HERE 

You are about to make a major career decision? — 
but only as part of a simulation exercise. You will find 
the process both educational and fun. 

You are to pretend ^that you want to decide on your 
life's work, or at least the job you want to try next. 
"Try to approach this task in the way you would really 
decide on a career. * 

This simulation exercise is self-explanatory. Your* 
next step is to find the cassette tape labeled "Direc- 
tions" above Tape 1 in the Cassette Tape Holder. Insert 
this tape in the tape player, push the "Play" button and 
follow the directions you will hear. 



The Directions tape. elaborates further on .the simulation's purpose and 
reviews its components and explains how to use them. In" addition to ex- 
plaining the mechanics 'of using the device, the tape provides all partici- 
pants with a uniform orientation. Participants learn procedures for using 
the following nine informational resources: . 
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Book or magazine: information from a wide variety of books and 

magazines. ' - . 



Career handbook : 
• X 

Career speaker: 



A friend: 
Horoscope : 

Newspaper ad: 



Personal 
experience : ; 

RaHio or TV:" 



information from* occupational dictionaries anc 
career guidebooks. 

information from speeches given at a lo: al c :r 
night presentation or classroom. 

information from conversations with friends. 

information from horoscopes written daily for an 
astrological sign. 

information from classified advertisements or want 
ads found in a daily newspaper'. 

information gained from possible personal experi- 
ences with jobs and cafeers. 

information from a variety of radio or television 
programs and commercials. 



information from talking with persons actually 
working on various jobs. 



Workers 
• interviews: 

\ , ■ 

Participants are also told that the information contained in these 
sources is organized by^ occupations and by' a set of work values. These 
work values are almost identical to those used by Katz (1973) in his work 
on SIGI and are listed here: early entry, helping Bthers, income, inde- 
pendence, leadership, leisure, prestige, security, and variety. 
> _ \ ' ' ' 

The Directions tape then points out that a set of' Value Definition 
.cardis is available to players who wish to clarify the meaning of any of the' 
CDS nine personal work values. Botli sides of one Value Definition card 
are reproduced below. \ r * 









What 


does the va^ue of "independence" mean? 






\ 






\ % ■ • ■ 


















\ ^ . 
'* \ , 












■■ ■ / ■ \ ^ • 




328 ■ 


\ • 234000 





51 



34 



\ 



Independence is the extent to which you make your own 
decisions and work without supervision or directions 
from others. 

If your occupation offers high independence, you would 
be your own boss. 

Low independence would mean working under close super- 
vision carrying out the decisions of others. 



The subjects are repeatedly informed that the object of the CDS is to pick 
one of the available occupations that gives them the most of tlje" things they 
really want in a job. The 12 possible fictitious occupations were given 
the following names: breandist, deptician, geebist, hister, jepist, krali- 
cian, onician, plinder, quentic, splacker, tasindic, and zampic. 

Players' actions are recorded by requiring them to place each card they 
read into the Card Return box. Thus for each CDS participant, data on the 
amount, particular kind(s), and sequence of information used in making a 
simulated career 'decision are available for subsequent analysis. 

Players stop performance on the CDS whenever they wish, up to the 90- 
minute time limit allowed. Actual performance is ended by writing the name 
of the selected occupation on the' Job Decision card, ^ and, as with all other 
cards, placing this card in the Card Return box. 

After players fil\ out and deposit the Job Decision card, they are 
asked to complete two rating tasks. The first task involves rating the- 
nine work values for the occupation just chosen as either high, medium, or ; 

^ow. This task is done on a device called the Job Ra^^ Form (see Ap- 
pendix G) , a wooden strip with indentions next to the mine labeled work 
values used in the CDS. Subjects are provided with color-coded, wooden 
pegs labeled H for high (blue) , M for medium (red), and L for low (yellow) , 
which are placed into the indentations on the Job Rating Form to indicate . 
judgments about' the ..level of each value for the chosen occupation. These, 
data are then used to compute an accuracy score to reflect how accurately', 

' the subjects interpreted the information used in making their career 
decisions. - ' 



The second rating task • (administered after all materials from the. f irkt 
one are removed) asks players to rate this same set of nine work values ini ' 
a way to represent an ideal or best possible kind of job for them. How- ' 
ever, an added restriction on this ^task requires them to rate three of the 
values high, three medium, and three low. An almost identical wooden strip, 
called a Personal Work Values Rating Form (see Appendix G) , is used for 
this forced rating task. Only the instructions at the top of the form are 
different, and the same wooden pegs are used to record value preferences. 
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Data generated by this second rating task, together with data generated 
4 weeks earlier by the same exact task administered in a paper-and-pencil 
format, are used to create the values congruence scores mentioned earlier 
and discussed under "Results" in this report. 

Information about, the fictitious occupations is organized within each 
of the nine sources described earlier. Each source contains information 
about three different values for all 12 occupations: Thus, a participant 
has 324 separate pieces of occupational information .from which to choose, 
or 36 per information resource. For six of these sources (book or maga-' 
zine, career handbook, a friend, horoscope, newspaper ad, and personal ex- 
perience) the information is written on 3" x 5" index cards. The cards 
are contained in separate boxes for each source, indexed alphabetically by 
job, and within each job alphabetically by the three different values 
represented there. Both sides of two representative cards are reproduced 
below. , 



A Friend 



Brearidist 



Independence 



101344 



"A friend tells you that one of the characteristics of 
breandlsts is that they are able to run their own af- 
fairs, make their own decisions, and 'sink or swim' 
based upon the decisions they make. He says they are 
not closely r>upervised, " 
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Personal Experience 


Deptician 

\ 


Leisure 




A 

■ ■ \ 

\ 








\ ■ 

\ . 
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"While working at the Big Blue Sky Resort area^ last 
summer you had a chance to meet arid talk with many of 
the vacationing guests. You were struck by the large 
number of djipticians spending their vacations there, 
Yoii also learned that many of these depticians visited, 
the resort 2 or '3 times a year, and usually for several 
weeks at a time," - . 



There are also 3" x 5" index^ cards arranged in the same fashion for 
the three, audio sources—career speaker, radio or TV, and worker interview.. 
However, these cards refer the player to the appropriate cassette tape con- 
taining information for that particular source, occupation, and value. The 
entire set of cassette tapes is housed in two labeled, revolving carousel 
storage units that hold 108 job information tapes (36 per information 
source) and the Directions tape, . 

A computer-assisted calculation of the CDS scoring key for values con- 
gl^uence scores resulted in a computer printout on 95 8-7I/2" x 11" pages. 
This key provides a handy way for the administrator to quickly determine 
a participant's values congruence scores on the CDS, The key is system- 
atically arranged to display the 1,680 different ways a subject can assign 
three high, three medium, and three low values from a set of nine differ- 
ent work values. For each of these 1,680 possible value level configura- 
tions, a raw score based on the CDS's scoring system (see A^endix G) is 
provided for all 12 of the fictitious occupations from which p^ticipants 
must choose. Thus, a participant 's score can be looked up, in the pi^intout- - 
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simply by knowing the ratings on the Personal Work Values Rating Form and 
the name of the occupation/written on the Job Decision card. Raw scores 
are transformed to create rank-order scores with a range of 1 to 12. A 
score of 12 represents the occupation with the highest raw score of the 
12 available— the occupation that best matches the participant's value 
preferences. 

• ' ' _ , <? - . 

The actual designing and production of the CDS posed several consid- 
erable challenges. Since several CDS units were needed to complete data ' 
collection in the. field, professional assistance was sought. The Medical 
Graphics Department of the Stanford University Medical School was asked to 
help design and produce most of the major components of the CDS. It was 
decided that a hardwood (ash) would be the best medium for making the 
Personal Work Values Rating Form, Job Rating Form, High Pegs, Low Pegs, 
Medium Pegs, and 11 Card Boxes (9 information sources , Value Definitions 
box, and Card Return box)'. Graphics in the form of lettering, thematic 
pictures, silk-screening, paint, and varnish were applied to the various 
pieces of each^ CDS unit . 

Making multiple copies of the CDS involved other considerations as 
well. Of primary concern was the need to have a sufficient supply of the 
336 informational and administrative cards needed for each player's per- 
formance on this- criterion instrument. After considering the problems of 
recording, sorting, and returning the cards to their appropriate locations 
after each administration, a decision wasmade to have a complete deck of 
336 cards printed, indexed, and collated for use with each player. Thus," 
70 card decks were prepared for the CDS administration. Since three of, 
the simulation's information sources (career speaker, radio or TV, and 
worker" interview) contain cards that direct a player to listen to ^ num- 
ibered cassette tape, it was also necessary to reproduce and label addi- * 
tional cQpies of each of the 109 audio cassettes. 

RESULTS AND DISCUSSION 

Results are summarized in this section under each major research hy- 
pothesis. The following main dependent variables were analyzed for dif- 
ferences betv^een the control and experimental groups:, (a) self-efficacy 
estimates of decision-making ability, (b) knowledge of rational career 
decision-making, facts and procedures, and (c) performatice on a simulated 
career d'ecision pro'blem. r- / 

The Stanford Center for Information Processing provided facilities for 
data analysis. The following Statistical Package for the Social Sciences 
(Nie et al., 1975) programs were used to analyze the data: Frequencies, 
Condescriptive, Crosstabs, Breakdown, Pearson Corr, Scattergram, ANOVA * ' 
(and covaiqiance analysis) , and Regression. Specific analyses are reported 
as they apply to the following hypotheses. . 

Research Hypotheses 

.Directional hypotheses were derived from the previously stated objec- 
tives and research questions and are listed below under each of the three 
major outcome measures. 
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I. Self-efficacy estimates of decision-making ability 



II. Students /in the treatment groups will report higher self- 
efficacy estimates of decision-making ability totaT scores 
than will controls on the posttreatment administration of 
. the Check. List of Decision-Making Ability (CLDMA) . 

2. Treatment students will obtain higher self-efficacy estimate 
total gain scores on the CLDMA than will control students. 

II. aCnowledge of career decision-making facts and procedures 

3. Treatment students will score higher than control students 
will score on knowledge of decision-making facts and pro- * 
cedures as measured by total scores on the College Board's 
Career Decision-Making Skills. Assessment Exercise (CDMSAE) . 

4. Treatment students will score higher than control students 
will score on each of the seven subsCore skill areas compris- 
ing the CDMSAE total score. 

.III. Performance on a simulated career d^^^^ ion problem 

5. -Treatment' students will obtain higher scores than will control- 

students on the following decision-making performance criteria 
assessed by the Career Decision Simulation (CDS) : (a) values 
congruence, (b) thoroughness of searching relevant informa- 
tion, (c) accuracy in interpreting information, and (d) self- 
rated confidence in the goodness of the de^cision. 

All of the above hypotheses were rephrased in the null form for purpose; 
of statistical analysis. Main effects and interactions of the major inde- 
pendent . variables (treatment, sex, and class/instructor) were analyzed for^ 
their contribution to scores on the criterion measures. Also, complete cor- 
relational analyses were performed to discern any meaningful relationships 
among the dependent variables. . ^ 



Interactions and 'Main Effects 

The following sections summarize the data for the major experimental 
findings. Main effects" data are reported as group means, standard devia- 
tions, and t^vaiues or F ratios with their corresponding statistical sig- 
nificance levels (£ values) . Interactions reflect the 2x2x4 scope of 
the factorial design, with two levels each- for treatment condition and sex 
of participant and four levels for class/instructor. Analysis of both 
variance and c^Dvariance procedures was done to analyze main effects and 
first- and second-order interactions. 



The Effect of Training on Self-Efficacy Estimates of 
Decis'^ion-Making Ability 

The Check List of Decision-Making Ability (CLDMA) was judged to be the 
least reactive criterion measure and was therefore the only instrument 

" • ' ^ ■ ■' ' ' ■ ■ / 
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is an M^hfi? ' f?" ^^^-^f*^^^ experimental treatment. The CLDMA 
iL ' ^^lf-"ting. measure that asks respondents to estimate 

?Trtfr7 """^^■^^'^^ their ability to perform certain decision behaviors 

. Ite'lie^^tpe^Si^rE)?^ ' ^"'^ °' ' ^° ' -c^^ * 

fl " - . • ■ ■ 

«ff,- J^*"^^ 5 summarizes central tendency data for 11 different self- 
J.^T'^^ estimate variables generated by the CLDMA. The first two columns 
^"^narxze pretreatment and posttreatment total score data. tL third c^! 
umn presents total gain score rpc;,,i^o t-u c- i • ^ , i-nxra co± 

individual ^^PT^ c.-tn results, and the final eight columns summarize 

individual Item gam score findings. For each self-efficacy estimate score 
ttlltsllnrflZ^^^ deviations, and t-values orVratiL and 

. Ji^Tlllll^^^^^^^^^^^ °^ the Treatment, se.. 

on thTluml ^""^r^^J^"^ results. emerge from the pretreatment total scores 
on the CLDMA. The theoretical , range for this variable is from 8 to 72 
The group means for experimental and control participants are nearly iden- 
tical and represent quite high scores. If participants -perceived the^r 
decision-making ability as average, their mean score would ha^e beenlLser 
to the midpoint of .the range. 40. instead of the 51 found. Both groups 

•cLarly°\\'the Tt T'^'/lt '""^ hypothetical mean oHo. 

Clearly, at the outset of the experiment . students assigned to both treat- 

•findi^r themselves to be better than'aver^ge This 

iTrt f -°"^i^tent with the results of numerous social psy^h^logy ex- 
■ fgyJr I/""-'^^ ^^^"^"8 epidemic of self-serving biases" (Myers & Ridl 
"as' ;.pa'r:rwJ^h th. ^^^^^^^^^^^^ ^^^^ ^<^-d-ts to tate" tLir abSSie. , 
almost^n "^'^^/^^ Pe'^on your age." the indication is that 

almost all respondents considered themselves better than average. 

h,-aho^^^°i^^ interest is the tendency for females in the sample to report • 

Jrfor toihe" ^^r'/''""'''^ "^''^ ^""^^^'^ ^^^^ their male counterparts 
■?or L .1 T °^ treatment = .079). Pretreatment CLDMA total scores 
Sfi «R -/instructor groups ranged from a low of\48.88 to a high o^ 

56.88 producing a statistically significant F ratio ^3.60) = 2.890; 
£ .U^J. It IS particularly interesting to note that\he highest pre- 
treatment^estimates of decision-making ability were generated brthe'e 
students from class/instructor Group 4~all recruited f rSh, the Orienta- " 
.'m^.^ third-year English class. These data suggest thaJ hi^r 

ability students may have higher self-ef f icacy expectations forperfo^ing 
certain decision-making behaviors. - . J-o^ perrorming 

.rn.Jf ^1^°""^ '^^^^^ ^ "P°^'^^ 8^°"P "•ean- °" the CLDMA^total 

score for, .the posttreatment administration. For. the treatment factorXthe 
trend^of the data-is in the hypothesized direction: experimenta^s reiol^ted 
somewhat higher self-efficacy estimates than did controL. Thfdif fe^eL^X 
^rl^tL^nt-'cLS^ lltll '''''''' sign ficant. For males and females, the post-^ 
cCss/inl^ r T - identical. The group means for 

?ioMn i ^ pattern similar to the pretreatment data, with 

Z - OoT " reporting significant ly-higher-scofTs 



"The next nine columns in Table 5 report mean gain scores for the ore- 
treatment and posttreatment CLDMA data. The first of these gain scores 
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Table 5 



Means and Standard Deviations for Check List ^of Decision-Making 

Ability' (CLDMA) Scores 



TrtatMiit 


Pr«- 

TraatfMcit 

Total 

Scora 


Fo«t- 
Traataant 

Total 
Scora 


* GAIH" SC0HZ3 
Total Ztan ll Ita« 12 It'am 13 . Iten 14 Iteti 15 It«a 16 Itaa l7 Item #8 


H SD 


H SD 


H SD 


H SD 


H SD 


H SD 


H SD 


H SD 


H SD 


H SO 


H SD 


11-29 


5L34 9.3 


S. 24 8.2 


3.93 8.5 


.62 1.2 


.66 1.7 


.62 1,6 


.41 2,3 


,62 1,6 


,62 1.6 


,31 1.6 


.24 2,1 


Control 
IL- 32 


51.19 9.5 


53.818.6 


2.53 8.1 


.59 .8 


.25 2.1 


.31 1.5 


.50 2.4 


.34 1.7 


.41 1.9 


-.09 1.8 


.19 1.8 


7£ - (1,60) 


0.004 


0.439 


0.435 


0.005 


0.680 


0.577 


0.021 


0.436 


0.217 


0.828 


0.012 


Z 


.948 


.5io 


.512 


.947 


' .413 


.450 


.887 


.512 


.643 


.366 


.915 


Sox 




• 




















Hals 

11-31 


49.19 8.8 


54.74 8.7 


5,81 7,8 


.81 1.4 


.97 1.9 


,74 1.4 


,87 2,4 


.48 1,8 


.74 2,0 


.74 1.8 


.52 1.7 


If • 30 


53.40 9.5 


54.23 8.1 


0.50 7.9 


.AO 1.7 


-.10 1.8 


.17 1.7 


.03 2.2 


.47 1.5 


.27 1.5 


-.57 1.4 


-.10 2.1 


t^-vmluas 

df - .(1,60) 


3.206 


0.055 • 


6.958 . 


1.046 


5.085 


2.066 


2.007 


0.002 


1.082 


10.048 


1.563 


Z 


.079 


.815 


.011 


.3U 


.028 


.156 


.162 


.968 


.303 


.002 


.216 


Croup 
























i 

|( - 16 


49.8110.3 


49:81 8.4. 


-,31 8.3 


.44 1.2 


-.25 1.7 


-.06 1.9 


0.0 2.7 


-.44 1.4 


.19 1.5 


.38 1.7 


«.50 1.9 


2 

W - 13 


A8Jtl0.4 


54.69 6.4 


6.50 7.9 


1.25 1.6 


.88 1.7 


.38 1.4 


.^94 2.4 


1.3 1.6 


.75 2.3 


0.0 1.6' 


1.25 2.2 


3 

(1-16 


4S.08 6.1 


52.77 8.2 


3.70 8.4 


-.38 1.6 


1.0 1.9 


.85 1.6 


.92 2.6 


.38 1.7 


1.23 2.0 


-.23 1.4 


-.08 2.0 


4 

N - 16 


M.88 7.7 


60.38 7.7. 


J.UO 7.6 


.94 1.5 


.25 2.1 


.75 1.3 


.06 1.4 


.69 1.5 


0.0 1.1 


.19 2.1 


.13 1.3 


F-Utlo 
df - (3,60) 


2.690 


'5.491 


1.931 


3.339 


1.427 


1.044 


0.750 


3.333 


1.443 


0.314 


2.553 


Z 


.043 


.002 


.135 


.026 


.244 


.380 


.527 


.026 


7240 


.815 


.064 


Total S«apU 
If - 61 


51.26 8.9 


54.49 7.6 


3,20 8.2 


.61 1.6 


.44 l;9 


.46 1.6 


.46 2.3 


.48 1.6 


.51 1.8 


.10 1.7 


.21 1.9 
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— ref-lects mean total gains over the entire eight-item instrument, with a 
theoretical range of -64 to 64 for this variable. Both the experimental 
and control groups reported slight gains in self-efficacy estimates of 
decision-making ability. The slightly larger gains of the experimentals 
os^nonsignificant (£ = .512). . 

A more interesting and quite unexpected finding is the mean total 
gain score difference for males. and females in the sample. Males outgained 
females by an average of more than 5 points/ a different .significant at the 
.011 level. Both experimental males and females outgained their control 
counterparts, the males by 7.29 to 4.59, .and the females by 0.80 to 0.20. 
From these data one might posit a significant treatment condition by sex 
interaction, but as Table 6 reveals, none of the two-way interactions for 
the analysis of variance (ANOVA)of CLDMA total gain scores is even close 
■ L^r.f,"^"^^^^''^^ significance. The main- effect for sex in this three-way 
ANOVA is quite significant (£ = .003), as one might expect from the t-value 
reported in Table 5. • . ' ~ 

Table 6 does report a significant thiree-way interaction for the ANOVA 
performed on CLDMAtotal gain scores: F(3,60) =7.936; p< .001. Figure 3 
Illustrates this interaction resulting from experimental males outgaining 
control males in class/instructor Groups 1 and 2. For females, the experi- 
mentals in Groups 3 and 4 outgained' their control counterparts. Means and 
standard deviations are reported in Table 7. These data suggest that in-, 
structors 1 and 2 were most successful in positively influencing the CDM 
self-efficacy estimates of their male students, whereas instructors 3 and 4 
were most successful with female students. Of course, it may also be that 
either male or female students from particular classes responded especially 
well to the treatment, or that the interaction between a particular in- 
structor and a given sex from a particular class or classes accounts for 
the results. 

The class/instructor group gain scores range from a low of .31 to a 
high of 6.50. Although the simple F-ratio for between-group differences 
is only 1.931 (Table 5), when the main effect for class/instructor is com- 
puted in a three-way analysis of variance (Table 6),' the F-raLio becomes 
2.812 (£-_.050). Thus, we can see that the classes from' which students 
were recruited and the treatirent instructors influenced the amount of total 
gain on the CLDMA, with stut^nts from class/instructor 2 outgaining stu- 
dents from other classes in self-efficacy estimates of CDM ability by a 
substantial amount. 



The final eight columns of Table 5 summarize the mean gain scores on 
each of the CLDMA' s eight individual items. Both' experi)nental and control 
students reported increased self-efficacy estimates on every item except 
item 7 (putting decisions into action) , on which controls 'showed a slight 
decrease. More importantly, with the excepti,. : of item 4 (generating al- 
ternatives) ,. experimental students reported higher gain in self-ef f icacy 
estimates of decision-making ability than r^"^trols on all of the indi- 
vidual items. However, just as with the pot,tLi<.. ..tmant total scores and 
total gain scores, the. superior item gain scores are not statistically 
significant. . As revealed by Table 5, the t^-v.alues for between-group mean 
differences .are quite low,, with corresponding significance levels ranging 
from only .366 to .947. A £ level of .050/or less was the decision rule 
applied to tests of significance for t^-values. 
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Table 6 



Analysis of^ Variance of Total Gain Score on the Check List 
'of Decision-Making Ability as a Function of 
Treatment, Sex, and Class/Instructor . . 



Source of 
Variation 



df 



Mean ■ 
Square 



Main Effects 
Treatment 
Sex 

Class /Instructor 



5 
1 
1 
3 



169.289 
43.915 
438.800 
125.091 



3.805 
0.987 
9.863 
2.812 



.006 
.326 
.003 
.050 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/Instr. 
Sex X Class/Instr. 



;7 

1 
3 

'3 



23.124 
14.467 
17.510 
26.161 



0.520 
0.325 
0.394. 
0.588 



.815 
.571 
.758 
.626 



3-Way Interaction 

Treatment x Sex 
X Class/Instr. 



3 
3 



353.069 
353.069 



7.936 
7.936 



<.001 
<.001 



Explained 

Residual 

Total 



15 
45 
60 



137.835 
44.491 
67.827 



3.098 



.002 
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Table 7 

Means and Standard Deviations for CLDMA Total Gain Score 

\ 



Class/ Ins true tor 
Group 



Males 



M 



SD 



Females 



M 



SD 



Totals 



M 



SD 



Total 



Experimental 


7.75 


7.50 


-6.0.0 


6.98 


0.88 r 


9.95 


Control 


.75 


7.27 


-3.75 


6.02 


-1.50 \^ 


6.63 


Experimental' 


14.50 


1.00 


-1.25 


0.96 


6.63 \ 


8.47 


Control 


2.50 


4.43 


10.25 


9.29 


6.38 


\^ 7.91 


Experimental 


0.00 


4.24 


10.33 


2.08 


6.20 


\ 6.2-2 


Control 


6.40 


^9.53 


-5 . 00 


4.58 


2.13 


\ 9.63 


Experimental 


.3.25 


12.37 


2.50 


4.04 


2.88 


\ 8.53 


Control 


8.25 


1.50 


-2.00 


7.. 07 


3.13 


\7.24 


Experimental 


7.29 


8.90 


0.80 . 


7.03 


3.93 


8.51 


Control 


4.59 


6.77 


0.20 


8.97 


2.53 


8.06 



Male students reported increased self-efficacy expectations on all \ 
eight items, while females reported lower self-efficacy expectations on 
items 2», 7, and 8. Item 2 relates to planning actions for making a de- • 
cision; item 7 refers to -putting decisions into action; and item 8 asks \ 
subjects to estimate how well they can recycle through various decision- \ 
making activities when present altera; J *ves are unsatisfactory. Males \ 
also achieved higher gain scores than t^inales on all eight items, with a • 
statistically significant difference for mean gain scores on item 2 (£ = 
.028) and item 7 (£ = .002). ' • - , 

For class/instructor group differences on individual item mean gain 
scores, only two items (1 and 5) were significant: £ = ,026 for both \ 
(item 1 relates to recognizing the importance of decision situations ,. while ^ 
item 5 refers to understanding the outcomes of various alternatives). As \ 
Table 5 shows, students from class/instructor groups. 2 and 4 reported a \ 
net gain on seven items; students from group 3 reported a net gain on five \ 
items; and students from group 1 reported a net gain on only three items. \ 
For the entire sample, the largest increase was reported for item 1 (recog- \ 
•nizing important decision situations), and the smallest increase was re- \ 
ported for item 7 (putting decisions* into action). The range here was quite 
small, however, going from .10 to .61 on a 9--point scale. 

The a'nalysis of covariance with pretest scores at; the. covariate is 
often preferable to simple gain-score comparisons (see Campb'ill & Stanley, 
1966; Kirk, 1968; Roscoe, 1975/* The advantage of covariance analysif^ 
o'-er simple analysis nf v^v ' 'ice depends on the relationship between -f^r^ 
pretest and posttest scores. If the variables are correlated nt lo<is ? 'ni 
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about .30,- any added advantage from covariance analysis is likely to be 
\. lost. Assumptions underlying the analysis of covariance are essentially 
.the same as those for the analysis of variance, with the added assumption 
of homogeneity of regression ,. which requires that the slope of the regres- 
sion line (predicting ^ from x) be the same within each of the populations 
under study (Roscoe, 19-75). 

With the above considerations in mind,' additi-onal analyses were per- 
formed on the Check List of Decision-Making Ability (CLDMA) total scores. 
First, it was noted that the correlation between the CLDMA pretreatment 
total scores and posttreatment total scores was .585, a significantly high 
coetticient. Second, the within-groups regression coefficient was esti- 
mated and found to be approximately the same for both experimental and' con- 
trol groups. These findings suggested that, it would be both appropriate 
and valid to perform an analysis of covariance on the posttreatment CLDMA 
total score, using the pretreatment CLDMA total score as the covariate. 

Table 8 presents data from a three-way analysis of covariance on post- 
treatment CLDMA total- scores, with pretreatment CLDMA total scores as the" 
covariate, and yielding main effects- on treatment condition, sex, and class 
instructor. Once again, the main effects due to treatment condition are 
not statistically significant (£='.362), although the covariance analysis 
yields a more encouraging significance level than the simple t-test between 
total gain scores (£ = .512). reported in Table 5. The effect~of sex of 
subjects on posttreatment total scores also looks more significant (droppin 
from £ - .815 to£ = .099) when pretreatment scores are treated as a co- 
variate. Although class/instruo-lior remains the only significant main ef- 
fect factor, its contribution is diminished in the three-way analysis of 
covariance, increasing from £ = .002 to £ = .015 (see Tables 5 and 8). 
No sigrtificant two-way interaction occurred. 

The three-way interaction among the treatment condition, sex of sub- 
jects, and class/ins-ructor variables .reported in Table 8 is 'significant : 
|'(3,60) = 4.548; £ = .007. Figure 4 illustrates this interaction result- 
ing from experimental males who reported higher scores than did controls 
for class/instructor Group 1 only, while experimental females reported 
higher scores than their control counterparts in Groups 2 and 3. Means 
and standard deviations .are reported in Table 9. Notice that with the ex- 
ception of females in class/instructor Group 3, there is little difference 
between the performance of experimentals and controls within each of the 
groups. Clearly, posttreatment estimates of CDM ability are most influ- 
enced by the class/instructor variable, somewhat less by sex of subjects, 
and least by treatment condition. Once again it appears that -students 
with superior verbal abilities (primarily those students from class/ 
instructor Group 4) rate their CDM abilities highly, regardless of their 
sex of participation in a structured training program. 

Even though the correlations between pretreatment and posttreatment 
item scores on the CLDMA are uniformly high (^ = .259 to .537;.£ < .02), 
an analysis of covariance was" not performed on each of the eight CLDMA 
item scores, primarily because' of the relatively small difference' in item 
scores across all factor levels, and partly because of the uninterpretable 
nature of such a restricted covariance analysis. Interested readers can 
review Appendix H for a summary of all CLDMA individual item means, both 
nretroatment: and posttreatment, for ail factor levels. 
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Table 8 



Analysis of Covariance of Post treatment Total Score on the Check List 
of Decision-Making Ability as a Function of Treatment, Sex, and 
Class/Instructor with Pretreatment Total 
Score as. a Covariate 



Variation 




Mean 
Square 


F 


n 


Covariates 


\: 1 


1437.723 


40.210 


<.00L 


Pretreatment Total Score 


\ 1 


1437.723 


40.210 


<.ooi 


Main Effects 


5 


114.242 \ 


3.195 


.015 


Treatment Condition 


1 


30.402' 


0.850 


.362 


Sex 


1 


101.780^ 


2.847 


.099 


V^J-doo/ XLIS L L UCL Or^ 










2-Way Interactions 


7 


19.599 


• 0.548 


.793 


Treatment xSex 


1 


8.03': 


0.225 


.638 


Treatment x .Class/Instr . 


3 


37.332 


1.044 


.383 


Sex X Class/Instr. 


3 


9.378 . 


0.262 


.852 


3-Way Interactions 


3 


162.623 . 


4.548 


.007 


Treatment x Sex 


3 


162.622 


4.548 


.007 


X Class/Instr. 










Explained 


16 


■ 164.625 


4.604 


;<'..ooi 


Residual 


44 . 


35.756 






Total 


60 


70.121 . 
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Table 9 



\ 


Means and Standard 


L/C v^ci L J. ons 


tor 


CLDMA Post treatment 


Total Score: 




\ 

Class /Ins true tor 


Males 




Females , 


Totals 






\Group 

\ 


M 


SD 


M 


SD 


■ !1 


SD 


. 1 


Experimental 
Control 


48.3 
46.5 


13.4 
9.0 


51.0 
53.5 


3.4 
6.4 


49.6 
50.0 


9.2 
•8.2 


2 


Experimental 
Control 


57.3 
57.5. 


5.2 
5.0 


' 53.0 
51.0 


9.4" 


55.1 
'54.3 


•7.4 

5 7 


3 


Experimental 
Control 


53.0 
55.2 


2.8 
6.3 


60.0 ' 
41.3 


- 1.7, 
5.0 


57.2 
"lO 0 


4.3 


4 


Experimental 
Control 


58.8 
60.5 


10.0 
7.8 


60.8 
61.5 


5.1 
8.6 


59.8 
61.0 \ 


7.4 
7.6 


Total 


Experimental 
Control 


54.5 
54.9 


9.6 
8.3 


55.9 
52.5 


6.9 
9.1 


55.2 
53.8 


8.2 
8.6 



The Effect of Training on Knowledge of Decision-Making Facts and 
Procedures 

The second .post treatment measure administered was the College Board's 
Career Decision-Making Skills Assessment Exercise (CDMSAE) , The CDMSAE is 
a 60-item multiple-choice test that assesses the student's knowledge of the 
rational decision-making process in general and the DECIDES' model of de- 
cisionmaking in particular. A student receives one point for each correct 
answer, making 60 the maximum possible total score on the instrument. The 
total score is comprised of seven subscores, each subscore representing 
one of the seven steps of the DECIDES^model. 

To determine if the career decision training result&d in experimental 
students obtaining superior results pn the CDMSAE total /score and subscores, 
_t- tests were performed between the experimental and contVol groups means on 
the eight scores. Table 10 shows the means and standardNieviations for 
these scores, along wi^th their t^-values and corresponding \lgnif icance 
levels. * ^ \ 

As hypothesized, experimental students outscored control students on 
the CDMSAE total score and on all seven of the subscores. . The total score, 
and the Identify Alternat?.ves , Discover Probable Outcomes, Eliminate Alter-) 
natives Systematically, and Start Action sub3core differences were all sig^ 
nificant at the .05 level or below. The only difference above the .10 1^1 
of significance was the Clarify Values subscore (£ = .102), and the otheJ : 
two subscore differences: (Define the Problem, £= .083; and Establish, anl • 
Action Plan, £ = .069) were very* close to the .05 level of significance. ( / 
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Table 10 



Treatment Group Means and Standard Deviations for Career Decision-Maki 
Skills Assessment Exercise Scores 



Subscores 



Treatment Group 


Total 
Score 


Define , 

the 
Problem 


Establish 
an Action 
Plan 


Clarify 
Values 


Identify 
Alterna- 
tives 


Discover- 
Probable 
Outcomes 


Eliminate 
Alternatives 
System- 
atically ■ 


Start 
Action 


Experimental 
{I = 29) 


•M 
SD 


3.9.7 
13.3 


2.3 
1.3 


8.7 
2.6 


6.1 
2.5 


6.3 

'1.8 


■ 9.2 
4.0 


4.3. ■ 
1.9 


2.8 
1.2 


Control 
(N =^2) 


M 
SD 


31.3 
10.6 


1.8 
1.0 


7.4 
2.5 


5.0 

. 2.4 


5.5 

1.5' 


7.0 
3.2 


2.6 
1.8 


2.1 
0.9 


N items 




. ,60 


4 


ii 


■ 9 


n 


16 


7 


4 


df = (1,60) 


_t 


■■7J38 ■ 


3.111 


3.444 . 


2.755 . 


3.853 


6.050 


12.394 


7.504 


4 


£ 


■ .009 


. .083 


• ..069 ■ 


,.102 


.054 


.017 


.001 


.008 



:G7 ,\ ■ , . ■ . ■ ■ ' ■/ ■ 
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These data clearly suggest that students who participated .in the training 
knew significantly more about the jDrocess of rational career decisionmaking 
than did control students, as assessed by an objective cognitive measure. 

- Since the results on the CDMSAE indicated such an overwhelmingly su- 
perior performance by experimerital students, the data were scrutinized more 
carefully^ Could the results be due to an expectancy . bias ? Were experi- 
mental students simply trying harder because of their participation in the 
treatment — did they believe that it was important' to do"* '^ell because they 
had spent 7 weeks learning about career decisionmaking: One way to invesr- 
tigate this question is to examine the total number of items 'attempted and 
the percentage ot items attempted, that were answered correctly by students 
in each treatment conditioin. ... 

Table 11 reveals that most students did. not finish the test* About " 
twice as many experimentals as controls completed the CDMSAE.* Although 
experimental students did answer about four more questions on average than ; 
did control students, the difference in their scores is not explained by 
this factor because experimentals averaged about 8 points-jiigher on 
their mean raw scores. Experimentals also were signif iqantly more accurate 
than were ccnitrols in answering whatever items were attempted. The only 
thing these data reveal is that although more experimentals completed the 
exercise, the superior scores of experimental subjects are not. completely 
accounted' for by a-signif icant mean difference in the number of items^ 
at temp ted ."^ , 

Another factor that could influence scores on the CDMSAE is the seri- ^ 
ousnoso of participants, or the degree to which they put* forth their best 
effort .In other words , to what extent did participants try to comprehend . 
and , find the best answer for each item attempted? This guestion cannot be 
answered with certainty because it requires a subjective interpretation of - 
the data, but several clues merit some discussion. First, as already pointed 
out, experimental students may have been trying harder, as evidenced by their 
attempt to answer more questions and to do a better job on the questions 
theyy^did attempt. An even better criterion of effort may be to estimate 
which scores (of completed CDMSAEs) appear" to be random guessing, and then 
eliminate these scores in computing group means • 

If students completed the CDMSAE by merely guessing at the answers, 
then they should obtain an average score of about 15 because there are four 
alternative responses for each of the 60 item^. Allowing for a standard - 
deviation of 10 points, any score in the 5 to 25 total points range might 
riepresent random^ guessing. A reyiew of the raw data reyeaTs that . of the 
12 experimentals completing the CDMSAE, 2,^participants fell within this 
range, while 3 of the 7 controls "obtained similarly low scores. It should 
b6' added that' the experimenter's observations of student behavior during 
the administration of the CDMSAE supports the a priori statistical inter-^ 
pretation of these 5 scores as random guessing. Table 11 indicates that 
only 2.5% more control participants biased the results negatively ' by ap- 
pSaring to guess randomly on the instrument. Also, the filial entry in • 
Table 11 shows that the adjusted raw score means (after eliminating the . 
5 guessing scores) do not change the significantly better performance of 
-students who participated in the training • ^ Thus , it seems reasonable to. 
cone lode 'tliat gro^p differences on the CDMSAE reflect true differences in 
.^nowledge and are not an artifact, of differing expectancy sets^ 



Table- 11 



TreaLmenL ^iroup Totals, Means," and Perce^rt tages on Selected 
CDMSAE Total Score Vocables 



.VariabLe 



Mean raw score (60 i)ossi.blci) 

I'ercent correct ^-r 

Number of items attempted 

Percentage of items attempted 
that were correct 

Number participants attempting 
all items 

Percent attempting alJ items 

Mean raw score for participants 
attempting nil items 

Number of apparent "guessers** 
(attempted all items and ob- 
tained raw score of 5 to 25) 

I'ercentage of "guessers" attempting, 
all , items . 

Percentage of "guessers" for entire 
sample 

Ad justed mean raw-- score (minus 
"gijessers") 



Experimental 
(N = 29) 



Treatment Croup 



r 

66.1 



I 

hi.i 



46. « 



16.7 



6.9 



40.9 



ConLrol ■ 
(N = 32) 



Difference 



31.3 
52.2 
47.0 

66.7 

7 

21.9 
33.7 



42.9 

/ 

9.4 

/ 

3 2. '8 



T 

/8.4 
13.9 
4.5 

10.4 

5 

19.5 
13.1 



26.7 



2.5 



8.1 



yhe next set of calculations performed oa the CDMSAE /data was based on 
a three-way analysis of covariance (ANCOVA) yielding main /effects on treat- 
ment condition, sex, and class/instructor: As 'mentioned earlier, certain 
pretreatment academic achievement^ data were obtained for /students partici- 
pating in this study. Specifically, grade-point^^ averages and scores on the 
math applications and reading comprehension sections of t:he Stanford 
Achievement Test Battery Analysis (also known as\the Stanford Task Battery 
Analysis) were available. All three, of these metric variables were highly 
correlated with the CDMSAfi: total score and subscores (see Table 12) . " 
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Table .12 



Pearson P^foduct-Momeht Correlations of Potential 
Coiirariates with Dependent Variables 



Covariates 



Dependent Variables 



Grade Point 
Average 



STBA<^ 
Math 



STB A 
Reading 



CLDMA 

Pre treatment total 
Post treatment total 
Total gain 

CDMSAE^ 
Total 
Define 
Establish 
Clarify 
Identify 
Discover 
Eliminate 
Start 

CDS*^ 

Values Congruence Time 
Values Congruence Time 
Accuracy 
Thoroughness 
Confidence level 
No. cards used 
. Time spent 



.083 
.070 
.002 



.596* 
.451* 
.491* 
.645* 
.458* 
.533* 
.439* 
.387* 



,034 

,255* 

, 304* 

,225* 

,107 

,244* 

,154 



,046 
,066 
,069 



,545* 
,462* 
.421* 
.584''-^ 
,331* 
.473* 
.425* 
.476* 



.174 

,114 

.431* 

, 127 

,034 

.497* 

.516* 



.032 
,113 
.158 



.622* 
.462* 
.504* 
.609* 
.420* 
.602* 
.448* 
.395* 



.282* 

.098 

.490* 

.213 

.078 

.514* 

.418* 



*£ - .05. 

^CLDMA = Check Lisr. of Decision-Making Ability. 

^CDMSAR = Career Decision-Making Skills Assessment Exercise, 
c 

CDS = Career Decision Simulation. 



STBA = Stanford Task Battery Analysis, 
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Therefore, the grade point average (GPA) and math and reading scores 
were treated as covariates in an ANCOVA. procedure after checking to make 
certain .that ti»fi homogeneity of regression assumption was not violated. 
This covariance -analysis is. a more refined calculation than simple analy- 
sis of variance. Wliene^ver two, measures are correlated, one can be used ' 
to^predict scores on the other. To the extent that performance on any 
dependent measure such as the CDMSAE can be- predicted from performance on 
pretreatment measures such as OPA or reading scores, this performance can- 
not be attributed to the experimental treatment. Tlie ANCOVA essentially 
consists of determining that .a proportion of the variance on the criterion 
variable existed prior to the intervention so that this F)roportion can be 
eliminated from the final analysis (Roscoe, 1975). \ 

Table 13 presents an ANCOVA for the CDMSAE total scores using GPA, 
Stanford Math Achievement, and Stanford Reading Achievement scores as the 
covariates. It appears that both GPA and reading ability/ account for a 
significant amount of the variance in total scores on the CDMSAE. However, 
even after the covariate variance is accounted for, the effect of treatment 
is significant at the .011 level — strong support for the superior perfor- 
mance of students participating in the experimental treatment. Since there 
are no significant two-way or three-way interactions, it would appear that 
the- treatment was not differentially effective with either sex, a particu- 
lar class/instructor group or groups, or either sex in a particular group 
in increasing overall knowledge, about the facts and procedures of rational 
career decisionmaking. 

Tables 14 to 20 present similar three-way analysis of covariance 
(ANCOVA) results, for the seven subscores of the CDMSAE. These subscores 
relate to the seven steps of the previously described DECIDES model (Krum- 
boltz & Hamel, 1977): Define" the Problem, Establish an Action Plan, Clarify 
Values, Identify Alternatives, Discover Probable Outcomes, Eliminate Alter- 
natives Systematically, and Start Action. 

The ANCOVA calculations performed-on the first four subscores did not 
yield any significant main effects or interactions (see Tables 14 to 17). 
For the Establish subscore, the class/instructor variable approached sig- 
nificance (£ = .077), with differences on this 11-item scale ranging from 
a low of 6.8 for Group 2 to a high of 9.1 for. Group 4, For the Identify 
subscore, the treatment variable approached significance (£ = ,098), with 
experimentals outscoring controls 6.3 to 5.5 on this 9-item scale. 

Just as with the total score on the CDMSAE, both the GPA and reading 
:score covariates account for a significant amount of the variance on most 
of the subscores. For the first four subscores, GPA is correlated sig- 
nificantly in three of the ANCOVA calculations and is close to significance 
in the fourth one: Define, .£ = ,078; Establish, £= .018; Clarify, £= .001; 
and Identify, £ = .020. The Stanford Task Battery Analysis reading scores 
correlate significantly with the 11-item Establish (£ = .033) and 9-item 
Clarify (£. = ,011) scales, and approach significance (£ = .099) for the 
9-item Identify scale. The actual correlation coefficients appear in 
Table 12- ' . . ■ ^ \, 

The ANCOVAs performed on the last three CDMSAE subscores all yielded , 
a significant main effect for the treatment- factor only and no significant 
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Table 13 



Analysis of Covariance of Total Score on Che CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor with 
CPA, Math; and Reading Scores as Covariates 



Source of 
Variation 



df 



Mean ^ T 
Square 



Covariates 
GPA 

Stanford Math 
Stanford Reading 



3 
1 
1 
1 



1543.453 
858.171 
124.291 
634. 782 



19.791 
11.004 
1.594 
8.140 



.on 

.214 
.007 



Main Effects 
Treatment 
Sex 

Class, 'Instructor 



5 

1 
1 
3 



150.346^ 
559.525 
0.637 
68.913 



1.928 
7.175 
0.008 
0.884 



.110 
.011 
.928 
.458 



2-Way Interactions 
Treatment x Sex. 
Treatment x Class/Instr. 
Sex X Class/Instr. 



7 

1 
3 
3 



39.070 
59.481 
9. 740 
59.606 



0.501 
0.763 
0.125 
0.764 



.828 
.388 
.945 
.521 



3-Way Interaction 

Treatment x Sex 
"x Class/Instr. 



155.969 
155.968 



2.000 
2.000 



.12') 
.129 



Explained 

Residual 

Total 



18^ 

41 

59 



340.193 
77.986 
157.981 



4.362 



.001 
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Table '14 



AnaLysis of Covariance oF "Define" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor with GPA, 
Math, and Reading Scores as Covariates 



Source of • Mean 
Variation _^ Square 



Covariates 3 8-151 6,888 -001 

GPA 1 ' 3,871 3,271 .078 

Stanford Math 1 1,619 1.368 ,249 

Stanford Reading 1 2.478 . 2,094 .155 

Main Effects : 5 0.749 . 0,633 ,676 

Treatment. 1 M.774 1,499 .228 

Sex' ' 1 0,415 ' 0,350 -.557 

Class/Instructor v ^ 3 0.564 0.477 ,700 

2- Way Interactions ^ ^ 0,750 0.634 .725 

Treatment X Sex . - 1- - 0,556 0.47jg^^ .497 

Treatment x Class/Instr, ^ 0.471 0.398 . ' •755 

Sex X Class/Instr. 1-016 0.858 ^^70 

3- Way Interaction ^ 0,338 -0.285 .836 

Treatment x Sex 0,338 0,285 .836 
X Class/Instr, 



Explained 

Residual 

Total 



18 1.915 1,618 .101 

41 1.183 
59 1,406 



74 

ERIC 



Table 15 

Analysis of Covariance of "Establish" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor with CPA, * 
Math, and Reading Scores' as Covariates 



Source of- 
Variation 



if 



Mean 
Square 



Covariates^ 
GPA . 

Stanford Math 
Stanford Reading 



3 
1 

i; 
1 



A4.A71 
25.704 
2.116 
20.639 



10.526 
6.08A 
0.501 
A. 885 



.001 
.018 
.483 
.033 



Main Effects 
Treatment 
Sex 

Class /Instructor 



5 

1 
1 
3 



8.219 
10.899 

0.098 
10.365 



1..9A5 
2.580 
0.023 
2.A53 



.108 
.116 
.880 
.077 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/Instr. 
Sex X Class/Instr. 



7 

1 
3 
3 



3.715 
7.733 
0.999 
A. 872 



0.879 
ir830 
0.236 
1.153 



.531 
.18A 
.870 
.339 



3-Way Interaction 

Treatment x Sex 
X Class/Instr. 



8.66A 
8.66A 



2.051 
2.051 



.122 
.122 



Explained 

Residual 

Total 



18 
Al 
59 



12.58A 
A. 225 
6.775 



2.978 



.002 



Table 16 



Analysis of Covarianc'e of "Clarify" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Clas.s/Instructor with CPA, 
Math, and Reading Score: as Covariates 



Source of 
Variation 



df 



Mean 
Square 



Covariates 
CPA 

Stanford Math 
Stanford Reading 



3 
1 
1 

1 



67.043 
41.755 
8.735 
19.205 



25.035 
15.592 
3.262 
7.172 



.001 
.001 
.078 
.011 



Main Effects 
Treatment 
Sex 

. Class/ Instructor 



5 
1 
1 
3 



2.973 
3.274 
0.219 
4.054 



1.110 
1.222 
0.082 
1.514 



.370 
.275 
.776 
.225 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/lnstr. 
Sex X Class/lnstr. 



7 
1 
3 
3 



3.744 
8.225 
2.154 
4.219 



1. 398 
3.072 
0.804 
1.576 



.232 
.087 
.499 
.210 



3-.Way Interaction 

Treatment x Sex 
X. Class/lnstr. 



3 
3 



0.862 
0.862 



0.322 
0.322 



.810 
.810 



Explained . 
Residual 
Total ' 



18 

41 



59 



13.599 
2.678 
6.010 



5.078 



.001 



7G 



58 



' • . Table 17 

Analysis of Covarinnrc of ^Mdentify'* Subscore on the CDMSAE as a Function 
of Truai uent, ^ and Clnss/Instructor with GPA, 
Math, and Reading Scores as Covariates 



Source of 
Variation 



df 



Mean 
Square 



Covariates^ 
GPA 



Stanford Math 
Stanford Reading 



3 
1 
1 
1 



14.251 
12.099 
0.075 
5.864 



6.916 
5.872 
0.036 
2.846 



.001 
.020 
.850 
.099 



Main Effects 
Treatment 
Sex 

Class/Instructor 



5 
1 

1 
3 



2.397 
5.911 
0.175 
1.636 



1.163 
2.869 
0.085 
0.794 



.344 
.098 
.772 
.504 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/Instr. 
Sex X Class/Instr. 



7 
1 

3 
3 



1.907 
3.97.5 
1.199 
1.783 



0.925 
1.929 
0.582 
0.865 



.497 
.172 
.630 
.467 



3-Way Interaction 

Treatment x Sex 
X Class/Instr. 



3 
3 



2.586 
2.586 



1.255 
1.255 



,302 
,302 



Explained 

Residual 

Total 



18 
* 41 
59 



"4.214 
2.061 
2.718 



2.045 



.029 



59 



Table 18 



Analysis of Covariance of !'Discover" Subscore on the CDMSAh as 
of freatment, Sex, and Class/instructor with CPA, 
Math, and Reading Scores as Covariates 



ir L ioi,, 



Source of 
Variation 



df 



Mean 
Square 



Covariates 
rGPA 
Stanford Math 
Stanford Reading 



3 

1 
1 
1 



117.795 
5A.219 

2.793^ 
75.477- 



13.863 
6.381 
0.329 
8. 883 



.001 
.015 
.570 
.005 



Main Effects 
Treatment 
Sex 

Class/Instructor 



13.301 
47.800 
0.869 
5 . 961 



1.565 
5.626 
0.102 
0.702 



.191 
.022 
.751 
.557 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/Instr. 
Sex X Class/Instr. 



7 
1 
3 
3 



1.978 
0.071 
0.565 
4.026 



0.233 
0.008 
0.067 
0.474 



.975 
.927 
.977 
,702 



3-Way Interaction 

Treatment x Sex 
X Class/Iristr. 



26.656 
8^.497 
14.037 



1.807 
1.807 



.161 
.161 



Explained 

Residual 

Total 



18 
41 
59 



3.137 



.001 



'8 



60 



Table 19 

Analysis of Covariance of "EliminaUe" Subscore on Che CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor with CPA, 
Math, and K;adlng Scores as Covarlates ' 



Source of 
Variation 



if. 



Mean 
Square 



Covarlates 
GPA 

Stanford Math 
Stanford P.aading 



21.12' 
13.223 
3.155 
5.503 



7.474' 
A. 680 
1.117 
1.947 



.001 
.036 
.297 
.170 



Main Effects 
Treatment 
Sex 

Class/Instructor 



5 
1 
1 
3 



7.830 
.32.303 
0.037 
2.921 



2.771 
11.432 
/I0.013 

1.034 



.030 
.002 
.910 
.388 



2-Way Interactions . 
Treatment x Sex 
Treatment x Class/Instr. 
Sex X Class/Instr. 



7 
1 
3 
3 



1.178 
0.074 
1.5 35 
1.360 



0.417 
0.026 
0.543 
0.481 



.886 
.872 
.655 
.697 



3-Way Interaction 

Treatment x Sex 
Class/Ins t.r. 



3 

3 



6.745 
6.745 



2.387 
2.387 



.083 
.083 



Explained 

Residual 

Total 



18 
41 
59 



7.277 
2.826 
4.184 



2.575 



.006 
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Table 20 



^^nalysis of Covariance of "Start" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor with GPA, 
Math, and Reading Scores as Covariates 



Source \of 
Variatibn 



df 



Covariates 
GPA 



Stanford Math 
Stanfoiid Reading 



Main Effect.-il 
Treatmenc 
Sex ■ \ 

Class/Instructor 



3 
1 

1 
1 



1 

1 
3 



Mean 
Square 



6.644 
1.734. 
3.046 
1.539 

1.109 
4,765 
0.002 
0.1,59 



6.220 
1.624 
2.852 
1.440 

1.039 
4.461 
0.002 
0.149 



.001 
.210 
.099 
.237 

.408 
.041 
.965 
.930 



2- Way Interactions 

Treatment x \Sex 

\ 

.Treatment x Class/Instr. 
Sex X Class/Instr. 

\ . 

3- Way Interaction 

Treatment x Sex 
X Class/Inst\f . 



Explained 

Residual 

Total 



7 
1 
3 
3 

3 
3 



18 
41 
59 



0.459 
0.077 
0.245; 
0.792 

1.455 
1.455 

I 

i 



1.837 

1.068 

1 ■ 
1.303 



0.430 
0'.072 
0.229 
0.742 

1.362 
1.362 



1.719 



.878 
.790 
.876 
.533 

.268 
.268 



.075 



\ 
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two-way or three-way interactions (see Tables 18 to 20). Experimentals 
outscored controls on all t'hree scales (see Table 10), and -the differences 
were significant in a three-way ANCOVA at the following signi ficance levels : , 
Discover, £ = .022; Eliminate, £ = .002; and Start, £ = .OA^. For the 16- 
iten Discover subscore, both CPA (£ = .015) and reading scores (£ = .005) 
were significantly correlated. Only CPA (p^ = .0*36) was a significant co~ 
variate for the 7-item Eliminate, subscore, and none of the covariates was 
significant in the ANCOVA performed on the 4-item Start subscore. 

To summarise the three-way ANCOVA findings for the CDMSAE total score 
and subscores,- treatment condition was the only significant main effect . 
factor, and there were no significant two-way or three-wa\ interactions. 
Treatment condition produced a significant main effect for the total score 
and three of the subscores, with experimentals outscoring controls in each 
instance.\^ These analyses yield the following observations : (a) Prior 
academic performance (CPA) and especially reading ability tend to predict 
scores on a measure of knowledge . about- the facts and procedures of career 
decisionmaking, and (b) even when such student attribute variables are ac- 
counted for, high school students participating in a structured decision 
training program do significantly better than their control counterparts 
on an extensively normed and validated cognitive measure of knowledge about 
career decisionmaking. 

Simple three-way' analysis of variance (ANOVA) calculations yielding 
main effects on treatment condition, sex of subjects, and class/instructor 
group were also performed on the CDMSAE data (see Appendix I). The ANOVA 
F^-ratios suggest an even stronger main effect due to treatment, but of 
coarse the variance in the error term attributable to the covariates is 
not taken into account. 

The Effect of Training on Performance on a Simulated Career 
Decision Problem \ 

The final post treatmenL measure administered was the Career Decision 
Simulation (CDS). As described previously, this instrument requires par- 
ticipants to make a simulated career choice among 1^\ available fictitious 
occupations. The CDS yields five different scores reflecting the quality 
of -a simulated career decision: (a) accuracy in interpreting the informa- 
tion used to investigate the chosen occupation; (b) a values congruence 
score based on a comparison of the actual work value characteristics -of thk 
chosen occupation with a participant's specified value preferences on a 
forced choice r^-uing task administered about 4 weeks prior to using the 
CDS; (c) a similar values .congruence score based on value ratings collected 
immediately after completing the CDS; (d) thoroughness in searching out 
information about the' three personal work values rated as most important 
immediately after completing the CDS; and (e) self-rated confidence that ' 
the occupation chosen represents the best one for the participant among 
the 12 available. More complete information regarding the functional deri- 
vation of these CDS scqres is contained in Appendix G, the CDS Administra- 
tor's Manual. * • 
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To determine if the training program resulted in superior C. J wr.^-.. 
formance scores for its participants, -t-tests were performed uet ' i ; 
group means for the experimental and control groups. Table 21 reVjJL..s 
treatment group means, standard deviations, ^-values, and significance 
levels for the CDS dependent variables. As with the affective (CLDMA) 
and cognitive ^(CDMSAE) measures, the results are in the hypothesized di- 
rection, with experifnentals outscoring controls on nil five. of the CDS 
performance criteria. 



' " - Table 21 

Treatment CJroup Means and Standard Deviations for Career 
Decision Simulation Scores 







a 


Values 
Congruence 


Thoroughness 


Confidence 


Treatment Croup 


Accuracy 


Time 1 


Time 2 


of Search 


Level 


Exper Lmerital 
(N = 29) 


M 
SD 


62.4 
11.3 


8.2 
3.0 


8.5 
3.2 


48.7 
15.3 


8.1 
1.2 


Ccmtroi 
(N = 32) 


M 


61.0 
15.5 


7.0 ' 
3.6 


7.5 
2.9 


41.5 
! 9.4 


■ i 7.5 
1.6 


cjlf = (1,59) 


t_ 


0.169 
.683 


1.993 
.163 


• 1.471 
.230 ■ 


4.864 
.031 


2.867 . 
.096 


The" ret Leal 
ranf^e 




10-85^ 


1-12*^ 


1-12^ 


o-ioo"^ 


I-IO'^ 



«5 = 100% accuracy. 



12 = best match. 



12 = best match. 



Percentage of information used relating to higii values. 
*10 = very confident. * • 



flowever , . only the thoroughness of search for information relating to 
highest values variable is- statistically significant (t_(l,59) = 4.86^^; 
H = .031). As explained in the methods section and Appendix Cj_tJ?e- thorough 
ness score reflects the percentage of information units ^uKetJI^y students 
relating to the three values specified as most important to them in a work 
situation. In other words , as Table\ 21 reveals, about 50%. of the informa- 
tion used by experimentals related to. their high values as compared to a 



,}ill\(i^r6^iiv40%: for cbntrolH.' '^.There are' several possible explaria-tf'ions for 
■ .■-.Lhi«i:findi^ mayjsimply be .using a moXe practical 

V ■':or.;j^f ficL^^^ more time and effort in -investi- 

vV^/it ing tlielr mffst . important personal work values. Such afn approach was 

•advpi:atecl^i An equally plausible interpreta- 

^Xtipnvoi^ the'^'d^^^ valties clarification. it may be 

"Uw^^^^^^^^^ information relating to their 

UigH* Vaiue^^^^ sense of their work value 

^:::!^firior Lrl^^s'. '\ 7^ Jnwfor ^yoal^ of ♦ thej* t reatipent ' s values clarification exercises 
}'^w;i« tb/JVielp^studehts Jjasses niosc. to them in an occupational 

vfsctting^i^. Perh;ll^^^ and values clarification expla- 

; nations V-kVc^^^^^ performance oC experimentals 

on this ratKer p criterion. , ^ • 

; \As''with].the othen/mcia^^^ 2..x 2 x 4 . analysis of variance or co- 

. var.i an(:e was condiic ted .with tlie CO.S scores . Tabled 12 indicates that only, \ 
rme CDS variable, .^acf'ura(:y, is" correlated with^ny of the covariates at 
r.^ .hiO fir higher. I Since the CDS accu'iracy score correlates highly with 
' al 1 three covariates ii.^i bhree-way ANCOVA' was performed yielding main ef- 
/fects on treatment conditifm,se^ of f?tudents, and c'lass /'ins t rue tor group, 
wjLh CI^A, ^laLh, ^nnd reading scores' as covariates . Table 22 -presents the*^ ; 
ANC/)VA fo^ CDS acturacy .scores . . i 

y >The y^ on the CDS accu- 

ral: v\sco^^ score on the Star^^jrd Task Battery Analysis 

■ i(S1'PiA;>-, makes sense because the CDS accuracy score 

- Is probabiy me^a^^^ readi hg : comprehens ion and short-term recall 

,V (for tiuise /whc) clLdn the informat-ipn they read 

orihenrd).? Tiiere are ho signi f leant' main effects, although sex of partici- 
jjnnts approaches '.significance (£ = .091) . Males outscored females 63.0 
s^-^'to f)0: 5 on the CDS accuracy scale even though femaTes in the sample out- 
:sc6red their mhle counterparts 59.8 ^to 58.8 on the reading comprehension 
sedition of the STIiA. , 

; As Table 22 indicates, the t1iree-way ANCOVA performed on the CDS ac- 
^:uracy score d i d y ie 1 d both a .significant . two-way and three-way interaction. 
The interaction between the treatment condition and cla^js/instructor group 
factors, F('3,58) ^ '3.289, £= .D'iO, is diagrammed in-Kigut'e 5, with mearis 
an(l standiird' deviatlons reported in Table 2;3. This striking two-way _ inter- 
action occurs beca^ise of the large discrepancy between experimental and 
Control performan(ie in class/instructor Croup 1, which is against the tr^nd 
of experimentals outscoring controls in the other three groups. The-,STBA • 
' reading scores in Table- 2A may help explain the interaction. Comparing 
1'ables 2Tand 24, the high correlation = .490) between tlie CDS accuracy 
scores, and ST KA read ing_sco res Mcomes apparent. Withtn each classyin- 
^istnictor group, the. treatment; condition group composed of students with 
' the highest readi ng . scores ffl^tained • the highest accuracy scores. — - 

: . : -The 'interact ion among the treatment, class/instructor,' and sex fac- 
by- the three-way ANCOVA on. CDS accuracy scores,^ F('3, 58) =. 
i^ 'W^'l^S^ £ ^r:0u9., is ill ustrated in Figure 6, with means and .standard 'devia- 
t in ;rable 25. Rxperimental males outscored control • males • in- 

./.uilass/instructor C^ '3 and. 4, while female exper imentals achieved higher 

. ' s counterparts in class/instruction C;r6ups 2 
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Table 22 



\ 



Analysis o£ Covariance of "Accuracy" Score on the CDS as a Fanction 
o£ Treatment, Sex, and Class/Instructor with CPA, \ 
Math, and Reading Scores as Covariates > ' ' \ 

■ ; \ ^ 

■ ; ■ \ 



Source of 
Variation 



Mean 



df 


Square 






3 


860.071 


9;643 


\ 

<.oo.i 


1 


25.484 


0.286 


■ \ 

.59fi 


1 


122.794 


1.377 


. 2dft\ 


1 


914.918 


10.258 


. on 


5 


159.050 


1.783 


• 138 \ 


1 


1.391 


0.016 




1 


267.627 


3.001. 


.091 


3 


173.132 


1.94^ ' 


.138 ; 


7 


186.500 


2.091 


.067 \ 


1 


77.060 


.0.864 


.358 • 


3 


293.305 


3. 289 


.030 1 


3 


92.055 


* 

1.032 


.389 ; 


3 


389.156 


4.363 


.009 1 


3 


389.157 


4.363 


.009 \ 










18 . 


324 -.913 


3.643 


: <.ooi 1 



Covariates 

CPA ' 
Stanford^Ma't^ 
' Stanford Reading 

Main Effects 

Treatment 
Sex 

Class /Ins tr.uct or 



\ 



2- Way Interactions 

T^reatment x Sex 
Treatment x Class /Ins trxictor . 
Sex ix Class/Instructor 

3- Way Interaction 
■ Treatment x Sex x Class/Instructor 3 



Explaiijied 
Residual 
•Totfal r 



40 
58 



89.190 
.162.345 




- Figure 5. Accuracy score on the Career Decision Simulation as a 
function of' treatment and class/instructor. 
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Table 23 



Means and Standard Deviations 
for CDS "Accuracy" Score 



Class/Instructor 
Group 


1 


2 


3 


4 . 


Totals 


Experimental 
Control 


M SD 


M SD 


H SD- 


K SR 


ii sn 


56.3 7.9 
72.5 12.0 


63.1 13.6 
51.3 13.0 


65.0 10.0 
60.7 18.1 


66.3 11.9 

59.4 12.9 


62.4.11.3 
6l'.'"b 15.5 



\ 

Table 24 

Means and Standard Deviations . 
~~~ror ~ST B A Reading~Score ^ 



Class /Ins true tor 
Group . 


1 


2 


3 


4 


Totals 


Experimental 
Control 


M SD 


M SB. 




JJ ^ 


M SR ^ 


39.9 24.1 
69.5 15.8 


61.3 33.3 
51.3" 13.8 


68.0 9.0 

51.1 30.7 


69.0 • 20.0 
66.6 14.3 


58.7' "26. 1 
59.9 20.3 



• 8g 

ERIC 




1 ' 2 3 4 1 . 2 . 3 4 

Class /Ins true tor 

Group Males ^ ^ . • Females 



Figure' 6. Accuracy score on the Career Decision Simulation as a 
function of treatment , sex, and class/instructor. 



tor c! a.s n ,r ^ oura"^' """'^ ^? cla.s/instructor Groups 2 and 4 

about I prn-nt ■ ,"uL fc-mll. r : ""trols outscored experimentals by 

points. • L oppc itc result'. ''""'"'f' by almost 20 

centals out's.:?rd\"nt^ f y" r;:L'tr bur'f'e^al'" ''T 

about 1 point hi«h.r than did exper^^entaU ""^-Is averaged 



Table 25 



Means and .Standard Deviations (Ml Factors) 
for CDS "Accuracy" Score 



Cl/iss/ rnstructor Males 
Croup ' M 



SD SD 



Females • _ Totals 



SD 



2 - 



f''xi)er imentnl 
C^ontro] • 


60.0 
73.8 


4.1 
13.1 


52.5 
71.3 


9.6 
12.5 


. 56.3 
72.5 ■ 


■ 7.9 
12.0 


^>.pe.r.^Jnc|nt;ll 
Control 

KxperLmentnl 
Cf)ntrol 


57.5 
58. « ■ 


15.0 
-8.5 


68.8 
. 43.8 


11.1 
13.1 


63.1 
51.3 


13. .6 
13.0 


65.0 
62.5 


14.1 
25.0 


65.0 
58.3 


10. 0 
5.8 


65.0 
•60.7 


10.0 
18.1 


Kxperi mc:nt,i] 
Control 


71.3 
56.3 


7.5 
18.0 


61.3 
62.5 


. 14.4 
6.5 


66.3 
59.4 


11.9 
12.9 


Kxperimental 
Corit rol 


63.2 
62.8 


10.8 
16.9 

_^ 


61.7 
59.0 


12.1 
. .14.0 


62.4 
61.0 


11 . 3 
15.5 



in a,a more ««nsUiv' ANOOVA'^LaUao;' '"--""y ^-"raction found 

.students r..U.d to <lirrer:na,"t Ih^ ™'rp \':;:"rj^f,™^r'"; 
cilcoL^tion., ^as d„n<= , using the factors of treat»™t, .s« a^d c?!l«/ 

•scuGcncs sex and cla.s.s/inst rue tor group membership. 

Tables 26 and 27 present the analysis of variance for the n^<^ i.^ o 
congruence scores. There are.no significant main effec[ror'-ntera:tS , 
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' Table 26 \ 

Analysis of Variance of CDS Values Congruence Score (Time 1) as a 
• -*.P(m&t^ion of Treatment, Sex, and Class/Instructor \ 

■ \ 

\ 



Source of 
variation 


df 


Mean 
Square 


F 


\ 
\ 

P . 


iMain Effects 


■ 5 


794,093 


0.699' 


\ 

• 627\ 


Treatment 


1 


2297,642 


2.022 


.162 \^ 


Sex 


■ 1 


130-444 


0.115 


. 736 ^ 


Class /ins true tor 


3 


538,568 


0.474 


.702 


2-Way Interactions 


7 


1723.826 


1.517 


.187 


Treatment x Sex 


1 


1987,154 


1.749 


.193 


Treatment x Class/instructor 


3 


2067,408 


1.819 


" .158 


Sex X Class /Instruct or 


3 


1481 1^1 


J.. JUf 


.285 


3-Way Interaction 


3 


305.540 


0.269^ . 


. 847 


Treatment x Sex x Class/Instructor 


' 3 


305.539 


0.269 


- .847 


Explained 


15 


1130.258 


0.995 


.477 


Residual 




1136. 401 _ 






_ Total . 


-59 


1134.839 
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Table 27 



Analysis of Variance of CDS Values Congruence Score (Time 2) as a 
Function of Treatment, Sex, and Class/Instructor 



Source of 
Variation 


_df 


Mean 
Square 


F 


p 


Main Effects 


5 


857.074 


0.912 


. 482 


Treatment 


1 


1393.708 


1.484 


.2?0 


Sex 


1 


129.006 


0.137 


. 713 


Class/Instructor \ 


3 


916.591 


n Q 7fi 




2-Way Interactions 


7 


1167.025 


1.242 


.301 


Treatment xSex 


1 " 


614.989 


0.655 


.423 


Treatment x Class/Instructor 




379.125 


n AHA 


• /Dl 


^ Sex X Class/Instructor 


'X 


21 78. 1 88 


9 "5 1 Q 


• Uoo 


3-Way Interaction 


3 


1028.340 • 


1.095 


.361 


Treatment X Sex x Class/Instructor 


3 


1028.339 ~~ 


.- 1.095 


.361 


\Explain€td 

\ ^ ' 


15 


1035.971 


- 1.103 


.382 


Residual . 

' \ • \ ■ 


44 


939.358V 






Total\ 


59 


. 963.921 
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for the values congruence scores based on" either the Time 1 or Time 2 per- 
sonal work, values rating -task. For the Time 2 (immediately after complet- 
ing the CDS) score, the interaction between the sex and class/instructor 
group factors approaches significance, F(3,59) = 2-3l9; ,088 (see 

Table 27). Nevertheless, treatment is clearly the strongest -main effect 
factor for both values congruence scores, A section of the .Nummary • 
discusses- the possible clinical significance of the superior, but nonsig- 
nificant,, performance by students participating in the training program. 

Table 28 reports the ANOVA performed on the CDS thoroughness of search 
scores. These data indicate no significant interactions and a significant 
main effect dO^ to treatment: F(l,59) = 5-572, and p = .023, The better, 
thoroughness se^ores achieved by experimentals reflect their use of about 
10% more information relating to their highest values,. and the ANOVA £ 
value for treatment is even more significant than the ^-test (]> = .031),- 
between treatment group means reported in Table 21, The significantly* 
better thoroughness of search scores achieved by experimentals' are prob- 
--ai>ly at least; partially responsible for the better values congruence scores 
also achieved by experimentals. • 

The final CDS variable, the confidence level score, "was analyzed 
through a three-way ANOVA reported in Table 29. As with the values con- 
gruence scores, there were no significant main effects or interactions'. 
The treatment condition factor accounts for more variance than the other 
factors, with experimentals reporting greater conf idence, about the quality 
of their ^simulated career choice than controls. However, the half-point 
-difference on a 10-point scale is significant at only the .108 level. 

: ' ' Intercorrelations Between Dependent Variables 

Table 30 presents the Pearson product-moment correlations between- the 
19 major dependent variables assessed in this study:- 8 CDMSAE scores, 5 * 
CDS scores, 3 CLDMA scores, and 3 academic achievement scores (CPA, STBA 
math, and STBA reading). The separate CLDMA scale scores are not reported 
in this correlation matrix because they consist of only one item each. 
However, Table 31 reports the Pearson r's between the posttreatment ^CLDMA 
item^scores and the corresponding subscales on the CDMSAE. This second 
matrix reveals the relationship between estimated ability to successfully 
perform certain decision-making behavior and knowledge about how to cor- 
rectly execute those same behaviors. . . 

Table 30 reveals that the CDMSAE total score' has a high positive cor- 
relation with the subscores, and that the subscores all have strong posi- 
tive correlations with each other (j> - ,01), These data are not surprising 
sinr:e the College Board .(1978) reports a KR-20 coefficient of .92 for the 
CDMSAE based on trials with 1,440 10th, 11th, and 12th graders, in five 
• states. This finding suggests that the content of the instrument, although ' 
covering separate decision-making skill areas, is quite homogeneous. It 
is also of interest to note that the mean CDMSAE. total score for the College 
Board (1978) sample was 35.35, with a standard deviation of 11 ,90 (compared . 
to 35.30 and 12.58, respectively, for the study reported here), with a 
standard error of measurement of 3.32. 
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Table 28 



Analysis of Variance of CDS Thoroughness of Search Score as" a 
Function of Treatment, Sex, and Class/Instructor 



Source of 




Mean 






Variation 


Af. 


Square 


F 


0 


Main Effects 


. 5. 


0.035 


1.891 


.115 


Treatment 


1 


0.104 • 


5.572 


.023 


Sex 


1 


0.019 


1.033 


.315 


- Class /Ins trucCor 


3 


0.016 


0.872 


.462 


2-Way Interactions 


7 


0.016 


0.858 


.546 


Treatment x Sex 


1 


0.019' 


1.030 


.316 


Treatment x Class/Instructor 


3 


0.018 


0.987 


.408 


Sex X Class/Instructor 


3 


0.012 


0.649 


.588 


3-Way Interaction 


3 


0.023 


1.246 


.304 


Treatment x Sex x Class/Instructor 


3 


0.023 


1.246 


. 304 


Explained 


15 


0.024- 


"1.280 


.254 


Residual . ' 


44 

0 


0.019 






Total 


59 . 


0.020 
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Table 29 

Analysis of Variance of CDS Confidence Score, as a FuncCioj 
of Treatment, Sex., and Class Instructor 



Source of /' ' ' Mean 

Variatica ._ df. Square F : ^ 



Main Effects • ^ 


5 


3.180 


_ 1.536 


.198 


Treatment 


1 


5.578' 


2.695 


.108 


Sex 


1 


5.164 


2.495 


.121 


Class /Ins true tor 


3 


1.642, 


0.793 


\ 


2—Way Interactions 


J 


1.216 


0.587 


.762 


TrpatTTipnt x Sex 


1 


0.719 


0.347 


.559 


Treatment x Class/Instructor 


3 


0.167 


0.081 


.970 


Sex X Class/Instructor . 


3 


2.442 


1.180 


.328 


3-Way Interaction 


3 


2.496 


1.206 


.319 


Treatment x Sex x Class/Instructor 


3 


' 2.496 


1.206 


.319. 


Explained \ 


15 


2.127 


1.027 


.447 


Residual 


•44 


2.070 






Total 


59 


2^084 
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Table 30 

Pearson Product-Moment Correlation Coefficients 
Between the 19 Major Dependent Variables : 



a 



O 

u 
fl 

% 



o 
%* 
o 

iS 



8 



3 
• 

X 



Total 

0«fln« 

EstablUh 

Clarify^ 

Idenclfy 

Discover 

EllmlnaCtt 

scare 

CPS "" ^ 

Accuracy 

Values 

Congru«nct(l) 
Value 

Congruence (2) 

Hioroughnaaa 

\ Confld«:nca 

CLCMA 

Total (Pre) 

Total (PoBC) 

Total Cain 

COVARIATES 
CPA 

STM Math 
STBA 

ii<««aing 



5 



Si 

> ex 

U 

-3 



1,00 


.69 


.89 


.86 


.71 


t95 


.82 


.82 


.58 


.22 


.04 


.31 


.26 


.26 


.17 


-.09 


.60 


.51 


.61 




61 


35.30 


12.58 


\ 


1.00 


.49 


.48 


.49 


.62 


.55 


.66 


.43 


\ 


.14 


.18 


.19 


-.01 


.02 


.07 


.45 


.43 


.4f> 




61 


2.00 


1.18 




\ 


1.00 


.75 


.60 


.81 


.65 


.65 


.51 


\ 
.12 


-.09 


.32 


.24 


.30 


.17 


-.14 


.49 


,41 


.50 




61 


8.02 


2.61 






\ 


1.00 


.54 


.78 


.65 


.62 


-.61 


.22 


.01 


.23 


.13 


.13 


-.01 


-.13 


.65 


.57 


.62 




61 


5.52 


2.47 










1.00 


.60 


.44 


.56 


.39 


.16 


\ . 
-\01 


.36 


.20 




.18 


.06 


.4fa 


.3Z 












.43 




61 


5{a5 


1.64 












1.00 


.74 


.76 


.52 


.19 


\ 

.04 


.26 


.26 


.35 


.26 


-.09 


.53 


.44 


.59 




L 1 


O AC 


3.75 












\ 


1.00 


.6a 


.44 


.15 


.12 


.22 


.22 


.15 


i05 


-.11 


.44 


,3fl 


.42 




61 


3.41 


2.04 














\ 


1.00 


.38 


.26 


.12 


\.20 


.27 


.25 


.24 


-.02 


.39 


.44 


.42 




61 


2.43 


1.15 


















1.00 


.27 


.20 


.10 


.06 


. 10 


-.08 


-.17 


.31 


..'39 


.51) 




6C 


fal.67 


13.52 


















\ 


1.00 


.36 


\ 

.18 


.15 


-.11 


-.08 


.06 


.25 


.16 


.16 




60 


7.56 


3.37 




















\ 


1. 00 


t21 


i.io 


-.23 


-.30 


-.05 


.03 


.15 


.28 




60 


7,97 


1.10 






















\ 


1.00 


.20 


-.25 


-.19 


.08 


.22 


.13 


.21 




60 


.44 


.14 
























\ 


v 

1.00 


.24 


-29 


-.07 


-.11 


.03 


^.14 




60 


7.82 


1.44 




















■ / ■ 






\ 


1.00 


.58 


-.51 


.08 


.04 


.09 




61 


51.26 


9.34 
























■ 


■, 


\ \ 


1.00 


.37 


.07 


r.04 


.12 


/ 


61 


54.49 


8.37 




























\ 




1. 00 


.01 


-.04 






61 


3:20 


8.24 
































\ 


1.00 


-.46 


.50 




6C 


2.81 


.52 


































\ 


1.00 


.59 




6C 


60.87 


23.46 




















i 
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Table 31 , 

- !' ' 

Pearson Product-Moihen t Correlatibn Coefficients Between 
Post treatment CLDt-lA and CDMSAE Subscores 
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I The CDMSAE scores, derived from a cognitive measure , are not highly 
orrelated with basic academic achievement scores, especially CPA and STBA 
reading scores, Thi^; -act is not surprising given the amount of reading 
required by the CDMSAC, ,and .Westbrook ' s (1980) research , which suggests a 
large overlap between cognitive measures of career development, such as the 
Career Maturity Inventory (Crites, 1973a, b) and a concurrent measure of 
readixig ability. 

The CDS was designed to be a performance measure — to assess a range 
of decision-making efficacy factors in a simulated career decision situa- 
tion. Only one of the five CDS scores, accuracy, is significantly corre- 
lated with all three of the covariates and the CDMSAE total score. Again, 
this result should come as no surprise, fr^he accuracy of interpreting in-e 
formation score is most likely 'a measure of reading comprehension, so that 
the high correlation with STBA reading (,50) seems quite reasonable. How- 
ever, the other Joyr CDS scores appear to be much less related to academic 
achievement or general aptitude indicators and more a reflection of inde- - 
pendent CDM perfor^iance skills, ^ - 



The CDS thbrotighness score correlated moderately with both CDMSAE 
total score (^ = .31) and CPA (£ = ,22)-, This criterion actually repre- 
sents an information search, strategy, and scores here might; be- expected to 
correlate with some kind of scholastic achievement factor./ In other words, 
,the most successful participants (ttis reflected by CPA and CDMSAE scores) 
were.'the ones receiving the highest 'CDS thoroughness scores. Perhaps of : 
-even greater interest is the finding that the thoroughnesis* score ife not 
significantly correlated ^with any of the other CDS performance criiteria. " 
The correlation does approach significance with the values congruence 
scores (r^ = .18 and .21) and the confidence level score :(£= . 20) , where 
such ^ positive relationship might be expected. Nevertheless, these data 
do support the thoroughness of search criterion .is ah independent index of 
CDM competence, but whether the criterion is a useful' measure remains to 
be determined, " • ^ ^ j 

A major- question addriissed in this study NConCerns the relationship;"'. 
between *self-efficacy estimates of CDM abilityVnd measured CDM knowledge 
and- performance. Table 30 reveals that although pretreatmenL CLDMA total ' ' 
scores are moderately correlated with CDMSAE total scores (t= ,26), the . 
posttreatment CLDMA total, scores are not,\. Also, Table 31 reports corre- ' 
lations between the posttreatment CLDMA item scores and the corresponding 
subscales on the CDMSAE, Only the correlation between the' Define subscore 
and CLDMA item 1 score is significant = ,32), suggesting that there is. 
little meaningful relationship between/estimated ability, to perform certain 
decision-making behaviors and knowledge about how to correctly execute 
those same behaviors, * - - 

The only significant positive correlation between the CLDMA total ' 
scores and a CDS variable involved the con f idence level score (r = ,24. ' 
and ,29 pretreatment and; post treatment , respectively) , This fin"ding makes 
sense intuitively because both scores can be saicl to measure self-confidence- 
the CLDMA based on past performances and the CDS based on an immediatV^oria^--^ 
In other words, self-efficacy estimates of CDM ability are not good| pre- c 
dictors of actual perfortpance in a simulated CDM situation, except re^^arding. 



thci participant's confidence abouu the performance. It should also be 
notcid thiat self-efficacy estimates of CDM ability were not significantly 
correlated with any of the academic ability factors, and that pretreat- 
ment and posttreatment CLOMA total scores were highly correlated (£ = .58). 

The values congruence scores are only moderately correlated with cog- 
nitive variables. The Time 1 score is positively correlated with the 
CDMSAIi: total score (jr = .22), CDS accuracy score (£ = .27), and GPA 
(r = .25). The Time 2 values congruence score is positively correlated 
with STBA reading (£ = .28) and negatively correlated with pretreatnent 
and posttreatment CAA)HA scores (£ = -.23 and -.30). These negative corre- 
lations suggest. that those subjects reporting the highest self~ef f icacy 
estimates of CJDM ability received the lowest values congruence scores 
based on their work value preference ratings immediately after completing 
the COS. 

Of particular Interest is the surprisingly low correlation (£ = .36) 
between the Time 1 and Time 2 values congruence scores, suggesting major 
shifts in value preferences over a relatively short time. The CDS task 
of actually choosing a fictitious occupation perhaps caused some students 
to adjust their value preferences in accordance with the characteristics 
of the chosen occupation. Table 32 reports the correlations between Time 1 
and Time 2 value ratings for all nine work values for the entire sample 
and for each treatment condition. Correlations vary widely for experi- 
mental s and controls on certain values such as early entry (in which con- 
trols were more consistent) and prestige (in which experimentals were more 
consistent), but no consistent pattern emerges. As Table 32 reveals, con- 
trols were more stable in rating their preferences for the first three 
values, while experimentals tended to be more stable in rating the last 
six values. 

Table 32 

l^earson Product-Moment Correlation Coefficients Between 
Time 1 and Time 2 Personal Work Value Ratings 



T ime 1 - Time 2 Correlation 

Knt ire Sample Cont rols Only Experimentals Only 
(N = 60) (N = 31) (N = 29) 
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Personal 
Work Values 



Overall, experimentals shifted their value preferences over time 
slightly less than did controls. The possible range of value difference 
ratings, with nine values given, three of which. must be rated high (3), 
three medium (2), and three low (1), is zero to 12 points. So, for ex- 
ample, a change in rating on one value from high to medium would create a 
difference of 1 point, while a change from high to lo^» on that value would 
create a difference of 2 points. Across all nine work values, controls 
averaged a difference of 4,97 points between their Time 1 and Time 2 rat- 
ings, while experimentals averaged a difference of 3,86 points. This dif- 
ference comes close to approaching the ,05 level of statistical signifi- 
cance, £(2,59) = 3,103; p - ,083, Perhaps the experimental treatment's 
values clarification component simply made these students more aware of 
their value preferences and therefore less likely to be inconsistent over 
a short period. 

Table 33 presents the means and standard deviations for the actual 
work value ratings (3 = high, 2 = medium, 1 = low) for all nine values at 
Times 1 and 2. Several things are striking about these data, .First, the 
rank-order ratings for the entire sample at Time 1 and Time 2 are nearly 
identical. The only shift occurred at the seventh and eighth ranked val- 
ues, prestige and leadership, which changed positions. Income, security, 
and independence consistently rank one, two, and three for both controls 
and experimentals at both Time 1 and Time 2. Also, prestige, leadership, 
and early entry tend to be the lowest-ranked three, generally ranking 
seven, eight, and nine, respectively. These findings shed some interest- 
ing light on the dominant value concerns of the sample studied. 

In summary, although the correlation between Time 1 and Time 2 CDS 
values congruence scores is only ,36, value preferences tended to be more 
stable than this correlation might indicate. The most stable value was 
income (no change in rating for 73,3% of the subjects), and the least 
stable value rating was for variety (no change in rating for 41,1% of the. 
subjects) . ' 

The major correlational findings can be summarized succinctly: 
(a) self-efficacy estimates of CDM abiJity are not significantly corre- 
lated with either CDM knowledge or performance scores; (b) CDMSAIi! (knowl- 
edge) scores are highly correlated with academic achievement data in a 
positive direction; (c) CDS performance scores are only moderately corre- 
lated with academic achievement data in a positive direction; (d) the 
generally low correlations among the major dependent variables suggest 
the independence of these attitudinal, cognitive, and performance measures 
of CDM; and (e) the separate^, indexes of CDM performance efficacy reported 
here for the CDS scores appear to be independent, 

SUMMARY, CONCLUSIONS, AND IMPLICATIONS 
Purpose 

This study was designed to investigate the effectiveness of a multi- 
component training program in career decisionmaking (CDM) on attitudes 
about, knowledge of, and ability to perform a specified set of CDM behaviors, 
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Table 33 



Means and Standard Deviations for Time 1 and Time 2 
Personal Work Values Ratings 
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A seven-lesson curriculum was administered in four different classes to a 
random half of a sample of students at hountdin V"iew High School in Moun- 
tain View, Calif, Thus, the major independent variable consisted of the 
presence or absence of a CDM skills training program, 

A basic assumption of a social learning theory of CDM (Krumboltz, 
1979) is that decision-making skills are products of learning experiences 
and can be directly modified through the application of learning princi- 
ples, Altho'igh systematic attempts have been made to help people develop 
CDM skills, little research has been done to evaluate these interventions. 
The study reported here assessed the effects of providing modeling, posi- 
tive reinforcement, guided practice, and appropriate resources in teaching 
a rational model of CDM, The goal was to assess the impact of a compre- 
hensive curriculum and to refine some instruments useful for both differ- 
ential diagnosis and program evaluation. 



Specific Objectives 
The specific objectives of the study were as follows: 

• Investigate whether a prescriptive, multicomponcnt CDM training 
program for high school students would produce these results: 

Superior performance scores on a simulated CDM problem; 

Superior knowledge scores on a standardized, cognitive measure 
of CDM principles and facts; and 

- Greater self-efficacy estimates of decision-making ability, 

o Observe how self-efficacy estimates of decision-making ability 
correlate with CDM knowledge and performance scores, 

• Observe how CDM performance, knowledge, and self-efficacy scores 
correlate with basic academic achievement data for the target 
population. 

Research Hypotheses 

Directional hypotheses were derived rrom the previously stated objec- 
tives and are listed below under each of the three major outcome measures, 

I, Self-efficacy estimates of decision-making ability 

1, Students in the treatment groups will report higher self- 
efficacy estimates of decision-making ability total scores 
than will controls on the posttreatment administration of 
the Check List of Decision-Making Ability (CLDMA) , 

2, Treatment students will obtain higher self-efficacy estimate 
total gain scores on the CLDMA than will control students. 
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Knowledge of career decision-making facts and procedures 



3. Treatment students will score higher than control students on 
knowledge of decision-making facts and procedures as measured 
by total scores on the College Board's Career Decision-Making 
Skills Assessment Exercise (CDMSAE) , 

4. Treatment students will score higher than control students on 
each of the seven subscore skill areas comprising the CDMSAE 
total score, 

III, Performance on a simulated career decision problem 

5. Treatment students will obtain higher scores thpXt will control 
students on the following decision-making performance criteria 
assessed by the Career Decision Simulation (CDS): (a) values 
congruence, (b) thoroughness of searching relevant information, 
(c) accuracy in interpreting information, and (d) self-rated 
confidence in the goodness of the decision. 

All of the above hypotheses were rephrased in the null form for pur- 
poses of statistical analysis, A £ value of ,05 or less was the decision 
rule applied to tests of statistical significance. Main effects and inter- 
actions of the major independent variables (treatment condition, sex of 
subjects, and class/instructor group) were analyzed for their contribution 
to scores on the criterion measures. Complete correlational analyses were 
performed to discern any n.eaningful relationships among the dependent 
variables. 



Method 

Subjects were obtained from four third-year English classes (although 
a few sophomores and seniors also participated) by visiting their class- 
rooms, explaining the training program, and asking for voluntary partici- 
pation. After stratifying by sex, approximately equal numbers of males 
and females were randomly assigned to four experimental and four control 
groups consisting of eight students each, 

A randomized * posttest-only control group design" (Campbell & Stanley, 
1966) was used with several modifications: (a) a stratified rather than a 
simple randomization procedure was used; (b) one set of dependent variables, 
self-efficacy estimates of > decision-making abilities, was assessed both 
pretreatment and posttreatment ; and (c) pretreatment academic achievement 
data were used as covariates in computing the main effects and interactions 
of the design factors.on several dependent vari^ibles. The 2x2x4 design 
used in this study reflects two levels each for the treatment condition 
and sex of students and four levels for a combined class of origin and in- 
structor factor abbreviated to class/instructor. 

Half of the students were assigned to four no-treatment control groups 
and did not receive any kind of CDM training. Experimental students in 
four separate classeii participated in a decision skills training program 
consisting of seven weekly meetings of about 1 hour each, plus homework 
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assignments • The experimental curriculum was based on the DECIDES model 
(K.rumboltz & Hamel, 1977), which provides guidelines for approaching de- 
cision situations in a sequential series of steps that enable a decider 
to reduce the levels of complexity and anibiguity in an orderly fashion* 

The general format for the CDM skills training included a combination 
of (a) didactic explanations of the concepts being taught, (b) demonstra- 
tions of how the skills can be applied to real life situations, (c) guided 
practice on simulated problems, and (d) opportunities to perform the skills 
independently. Emphasis was placed on identifying important decisions of 
current relevance for practicing decision skills training. Instructors 
employed technique^^ of modeling and positive reinforcement and provided 
students with data about important informational resources. Some of the 
major topics covered in the training included the following: clarifying 
values and conducting self-assessment, identifying and using worthwhile 
informational resources, using objective data and subjective impressions 
to evaluate possible options, changing inaccurate self-attributions and 
occupational stereotypes, and restructuring the personal environment to 
increase the likelihood of engaging in desired decision-making behaviors, 

Threa criterion measures were used to assess the effectiveness of the 
CDM skills treatment. The Check List of Decision-Making Ability, adminis- 
tered before and rfter training, measures self-rated efficacy estimates of 
Jl particiyjant ' s ability to perform certain decision behaviors and provides 
data from the affective domain. The Career Decision-Making Skills, Assess- 
ment Exercise, a cognitive instrument, measures knowledge of facts and pro- 
cedures relevant to CDM, Performance domain data were generated by the 
Career Decision Simulation, an individually administered instrument that 
assesses how well a person performs a simulated decision task. 

Specific Findings 

The results of this study provided some evidence that a structured 
training program in career decisionmaking based on social learning princi- 
ples is effective in producing superior scores on measures of career 
decision-making competence. The findings are' summarized below under the 
headings of the tbjree major outcome measures and five directional hypothe- 
ses listed previously, 

I, Self-efficacy estimates of decision-making ability 

1, Students in the treatment groups reported higher self-efficacy 
estimates of decision-making ability total scores than did 
controls on the posttreatment administration of the Check List 
of Decision-Making Ability (CLDMA) , The mean scores were 
55,24 for experimentals and 53,71 for controls, yielding a 

2^ value of only ,510, ... 

2, Treatment students obtained higher mean self-efficacy estimate 
total gain scores on the CLDMA than did control students (3,93 
to 2,53, yielding a value of only ,512), 
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II. Knowledge of career decision-making facts and procedures 

3. Treatment students scored significantly higher than control 
students on knowledge of decision-making facts and procedures 
as measured by total scores on the Career Decision-Making 
Skills Assessment Exercise (CDMSAE) . The mean scores were 
39.7 for experimentals and 31.3 for controls, yielding a p 
value of .009. 

4. Treatment students scored higher than control students on each 
of the seven subscore skill areas comprising the CDMSAE total 
score. The Rvalues ranged from .001 to .102, with the Iden- 
tify, Discover, Eliminate, and Start subscores at or below the 
.05 alpha level. 

III. Performance on a simulated career decision problem 

5. .Treatment students obtained higher scores than control students 

on all five c^f the decision-making performance criteria assessec 
by the Caree^ Detiision Simulation (CDS). However, performance 
differences on only one of the CDS variables, thoroughness of 
search on high values, yielded a significant £ value. On this 
criterion, experimentals outscored controls 48.7 to 41.5; 
£ = .031. 

IV. Correlations among dependent variabl^-s 

The major correlational findings were as follows: (a) self- 
efficacy estimates of CDM ability are not significantly corre- 
lated with either CDM knowledge or performance scores; (b) CDMSAE 
(knowledge) scores are highly correlated with academic achievement 
data in a positive direction; (c) CDS performance scores are only 
moderately correlated with academic achievement data in a positive 
direction; (d) the generally low correlations among the major de- 
pendent variables suggest the independence of these attiLudinal, 
cognitive, and performance measures of CDM; and (e) the separate 
indexes of CDM performance efficacy reported here for the CDS 
scores appear to be independent. 

Conclusions and Implications for the U.S. Army 

The results of this study suggest moderate support for the effective- 
ness of the experimental CDM training program with a population of secondary 
school students. Specific observations, generalizations, and inferences 
are noted below, but they cannot necessarily be generalized by a population 
of U.S. Army personnel without further study. 

1. The most striking findings from the CLDMA self-efficacy data re- 
late to the sex of participants and class/instructor group factors. Al- 
though experimental and control participants reported nearly identical total 
scorp means on the pretreatment administration, experimentals scored about 
2 points higher on the posttreatment administration — a nonsignificant dif- 
ference. However, males in the sample outgained their female counterparts 
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by over 5 points — a significant difference. It is also the case that males 
averaged about 4 points lower than females averaged (almost a significant 
difference) on pretreatment total CLDMA scores. Since both experimental 
and control males reported sizeable score increases, one cannot say that it 
was the experimental treatment alone that was differentially effective in 
significantly increasing the CDM self-efficacy estimates of males in the 
sample. The greater gains* in self-efficacy estimates for males is a sur- 
prising finding not predicted or discussed in any of the literature on 
sex-linked differences in affective or attitudinal development. 

2. The class/instructor group differences on CLDMA scores may be 
easier to explain. One class/instructor group (Group 4) reported signifi- 
cantly higher scores than did the other three groups in the pretreatment 
administration of the CLDMA. Posttreatment CDM self-efficacy estimates 
were also significantly higher for this group, but the mean gain was about 
average for the entire sample. Students comprising class/instructor Group 
4 were all drawn from the same advanced third-year English class (Orienta- 
tion to College). This tracked class was made up of juniors and a fev7 
sophomores with superior performance records in English and related sub- 
jects. The CLDMA data gathered in this study suggest that students with 
superior academic abilities (or perhaps those placed in advanced classes) 
have significantly higher self-efficacy estimates of their ability to per- 
form a range of CDM behaviors. 

3. In general, results from the CLDMA were somewhat disappointing. 
First, the treatment was not effective in producing significantly higher 
self-efficacy estimates of decision-making ability in experimental group 
students. One could argue that although practice in learning a practical 
problem-solving approach for handling decisions might increase self- 
confidence, full awareness of the complexities of decisionmaking might 
offset this gain. However, other factors probably better explain the find- 
ings. Experimenters noted how very hastily and almost cavalierly students 
(especially controls on the posttreatment administration) responded to the 
eight-item CLDMA. Furthermore, there is some reason to doubt how carefully 
or sincerely students were responding because neither the cognitive nor 
the performance score data substantiated their relatively high estimates 

of their decision-making competence. On the other hand, such seemingly 
inflated beliefs about decision-making prowess may hold up across other 
samples and populations and be an artifact of the culture, the format of 
the instrument, or both. 

4. Results from the College Board's CDMSAE knowledge test were by 
far the most impressive outcome data in this study. Students participat- 
ing in the CDM training program outscored control students on the total 
score and on all seven subscores. Diffei^nces were statistically signifi- 
cant for the total score and for four subscores. However, some caution 
must be exercised in interpreting this finding. The curriculum units for 
the decision skills training program ware patterned after the DECIDES 
model, the same model used to develop and group individual items in*-.o the ^ 
seven skill areas for the CDMSAE subscores. One could argue that the ex- 
perimental training taught to the CDMSAE criterion measure. However, the 
instructors were not informed about the content of the test items, nor was 
the curriculum specifically constructed to cover the test items. The ef- 
fects of the intervention were powerful, even when taking into account 
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differences in completion rates and random guessing on the instrument. 
It appears that high school students participating in a structured CDM 
skills training program do significantly better in recognizing the facts 
and principles of rational decisionmaking than do their nonparticipating 
peers. Whether this superior knowledge translates into superior perfor- 
mance is a more complicated question to answer. Army personnel might find 
the curriculum equally effective, particularly if military examples were 
substituted. 

5. The most difficult data to interpret are the performance score 
results from the Career Decision Simulation (CDS). Clearly, although ex- 
perimentals were slightly more accurate in interpreting the information 
used relating to their job choices, students in both treatment conditions 
did extremely well on this variable. Their relatively high accuracy scores 
probably reflect the somewhat simplistic, unambiguous nature of most of the 
information units. If the information had been more complex, ambiguous, 

or difficult to interpret (as is often the case in real life), perhaps the 
more systematic search efforts presumably employed by experimentals would 
have resulted in significantly higher scores. However, since CDS accuracy 
scores correlate so highly with reading scores for this sample, it may be 
that the findings are tapping into a general abilities factor that is not 
affected by the treatment. 

6. It is apparent that experimentals were more likely than were con- 
trols to see the importance of concentrating their search on highest rated 
work values. Again, this was a concept emphasized in the treatment. The 
significantly higher scores of experimentals could be interpreted as an 
artifact of the training program but may also represent a superior search 
strategy. This remains an empirical question since the thoroughness of 
search variable is more of a process than an outcome criterion. Researchers 
could speculate that the experimentals' higher CDS confidence level (in 
choosing the. best occupation) scores might be due to the greater effort 
invested in examining occupational information relevant to their most prized 
values in a work setting. 



The experimental curriculum was successful in teaching high school 
students to seek out primarily only that information pertinent to their 
highest values. Army personnel are assigned specific missions that influ- 
ence the values to be achieved, so a similar curriculum might well be de- 
vised to help soldiers search for the most crucial information in making 
military decisions. 



7. The values congruence scores are the CDS variables most central 
to conceptualizing the goodness or efficacy of , a student's performance on 
a simulated career decision problem. These scores really represent the 
extent to which individuals are able to choose an alternative that is 
consistent with their previously specified value level preferences for an 
occupation. 

Although neither of the rank-order differences for the Time 1 or the 
Time 2 values congruence scores are statistically significant, the effect 
size is noteworthy and may have some clinical significance. Experimentals 
outscored controls by a difference of 1.2 rank-order units (a chance score 



87 



105 



was ,6.5, and the maximum score was 12) on the Time 1 score and by 1.0 units 
on the Time 2 score. Given the amount of discontent and dissatisfaction 
that have been reported in the military services, the ability to choose a 
job that is even slightly better suited for an individual in terms of its 
characteristics and rewards may be an important outcome. The Time 1 dif- 
ference, which is larger, may be even more significant because the values 
there were stated long before the decision was made. 

8. Correlations among the 16 major dependent variables and 3 covari- 
ates assessed in this study produced some interesting patterns of associa- 
tion. Self-efficacy estimates of CDM ability did not correlate highly with 
either CDM knowledge or performance scores. CDM knowledge was somewhat 
positively correlated with CDM ability as assessed by uhe CDS, especially 

on the accuracy, thoroughness of search on high values, and confidence level 
variables. With the exception of the CDS accuracy score, the only outcome 
variables significantly correlated with academic achievement factors were 
the CDMSAE knowledge variables. Overall, the generally low correlations 
support a multimeasures approach to assessing career decision training out- 
comes in several domains. 

9. The trend of the data is striking. Expel imentals outscored con- 
trols on all 16 major outcome variables. Differences were statistically 
significant on six, or clDout 40%, of these variables. Of course, the pos- 
sible error introduced by multiple comparisons using so many _t^tests must 
be acknowledged — with 20 dependent variables, the probability is that by 
chance alone at least' one experimental versus control difference will be 
significant at the .05 level. A more intensive training program or a 
larger sample size might produce even more significant differences. Other 
potential independent variables such as time lag between training sessions, 
particular content areas covered, and instructional techniques used could 
be just as crucial in shaping the results. Given the nature and size of 
the sample reported in this study, these findings cannot be conclusive but 
do suggest some useful approaches deserving attention. 

Limitations and SuKRestions for Future Research 

The research reported here represents an extensive pilot study for the 
kinds of investigations needed to improve training and assessment efforts 
in the career decision-making area. Limitations in the present study and 
suggestions for related research are noted below. 

1. This study should be replicated. Inclusion of multiple replica- 
tion sites would improve the design. 

2. The instructor variable was confounded with the separate sampling 
pools (intact classes) in this study. Future experiments might systemati- 
cally control for the age, sex, and previous counseling or teaching experi- 
ence of instructors. 

3. There is no evidence to suggest what size of group is optimal for 
conducting CDM skills training. Future studies might experiment with 
smaller or larger group sizes than the eight subjects per group used in 
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the present study. The obvious advantage in working with smaller numbers 
is the greater opportunity for individual attention and all the positive 
reinforcement and participant modeling this would allow. However, school 
administrators might see smaller groups as less cost-effective from a per- 
sonnel point of view. Comparative outcome studies can best settle this 
issue. 

A. Evidence is also lacking regarding the most efficient number, 
length, and pacing of sessions. This study employed seven consecutive 
weekly sessions of about 1 hour each. Would fewer or shorter sessions have 
worked as well? What about one session per day for an entire week or one 
7-hour session? The present study suggested the benefits of a protracted 
format that allows for practicing the CDM skills in the real world between 
training sessions. A previous study (Krumboltz et al., 1979) indicated 
that a single 90-minute training session was unable to demonstrate signifi- 
cant improvements in CDM competence. 

5. The present study employed a multicomponent intervention that in- 
cluded the use of positive reinforcement, modeling, the provision of ap- 
propriate informational resources, and a number of structured exercises 
and activities. There is no way of knowing to what extent each of the 
separate components contributed to the outcomes. Subsequent research could 
employ several different levels of an experimental treatment to assess the 
relative effectiveness of separate components. 

6. The Check List of Decision-Making Ability (CLDMA) is a weak in- 
strument. In its present fori.: it is probably not a good measure of what 
Bandura (1977) refers to as self-efficacy. It should be revised to embrace 
the dimensions of duration and intensity of effort that are part of the 
self-efficacy research literature. Also,* the CLDMA should be lengthened 

by a factor of two or three from its present eight items to increase its 
reliability. More extensive field-testing will be required to establish 
noriT^^tive data for the instrument. A search for similar experimental mea- 
sures should be conducted for the purpose of assessing its concurrent 
validity. 

7. Although the Career Decision Simulation (CDS) has already evolved 
through several major revisions, further modifications are needed. Face 
validity could be improved by (a) increasing the variety of information 
sources and number of information units; (b) allowing participants to in- 
teract with the simulation for a longer period of time, perhaps during 
several time-delayed sessions; and (c) making the content of the infor- 
mation units richer and more realistic — more complicated, more ambiguous, 
and occasionally contradictory. 

Also, in its present form the CDS does not introduce or in any way 
provide for the advent of chance occurrences. Unpredictable events and 
unforeseen changes in circumstance play a major role in the career de- 
cisionmaking of most individuals. The ability to cope with such change 
and chance is an important CDM skill. Future research with any CDS-like 
simulations should seek a way to systematically incorporate a chance oc- 
currence factor into the instrument. 
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8. The CDS yields a cumulative, sequential record of all information 
used to make a simulated career choice. Thus, the CDS not only provides 
researchers with outcome scores, but it also provides data from which in- 
ferences can be made about a participant's decision-making procedure or 
style. It is possible to gather information about both decision-making 
processes and outcomes and see how these data correlate for individuals 
with varying decision-making predispositions and exposed to different in- 
structional treatments. Unfortunately, this rich store of process data 
has yet to be investigated thoroughly. 

9. .In its present form, the CDS is prohibitively expensive to repro- 
duce and difficult to transport. It would probably be relatively easy to 
write a computer program that would enable participants to interact with 
the CDS .at a CRT terminal. The development of such a software package 
would greatly increase the CDS's use as a research tool and program evalu- 
ation instrument, and possibly as an instructional aid. 

10. The CDS has great potential as an induction aid or teaching de- 
vice in a career skills training program. Students are unanimous in re- 
porting their enjoyment in using the CDS. It has strong motivational 
value, features a learn-by-doing format, has a life-like and nonacademic 
quality, and provides a compact, controlled learning environment. As part 
of an introduction to a bounded rationality approach to making career de- 
cisions, the CDS would be appropriate for a variety of populations. 

11. Although the training program used in this study covered aspects 
of false occupational stereotypes and inaccurate self-attributions related 
to occupational aspirations, future studias should deal more explicitly 
with the emotional aspects of career decisionmaking. Belief sy.tems should 
be delineated, explored, and perhaps challenged or modified. Both the in- 
terventions and the criterion measures should be sensitive to emotional 
influences on CDM competence. 

12. Investigators need better measures to assess career development 
outcomes, particularly in the decision-making area and in the performance 
domain. Sound behavioral measures are particularly scarce. In assessing 
CDM competence, researchers need to improve the technology available for 
both program evaluation and the differential diagnosis of individual skill 



deficits. 
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APPENDIX A 
STATEMENT OF CONSENT^ 

I, (please print your name) 
certify that I understand that I will be participating in a research 
project designed to evaluate the effectiveness of a career decision- 
making training program. I understand that if I am assigned to one 
of the training groups I will be expected to attend a class one period 
each week for 8 weeks, and asked to complete brief assignments requir- 
ing about 1 hour of work outside of class each week. Regardless of 
which group I am assigned to, I understand that I will be asked to 
spend an additional 2 hours completing several exercises that measure 
ray attitudes, knowledge, and skills in the area of career decision- 
making. 

I further understand that I am free to withdraw my participation 
in the study at any time. I understand that any information collected 
is strictly confidential, and will be viewed with ry name present only 
by those directly affiliated with the project. Also, I am aware that 
jf I am dissatisfied with any aspect of the project at any time, I may 
report grievances anonymously to the Sponsored Projects Office at 
Stanford University at phone number (415) 497-2883. 

Signed: 

(Research Project Participant) 

Address: 

Phone No. 

Date: 



Note: Check this box if you do not wish to participate. 



□ 



^Consent forms distributed to students in English classes at Mt. 
View High School in January of 1979. 
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APPENDIX B 

PROPOSITIONS JIAl, IIA2, and IIA3 FROM KRUMBOLTZ'S SOCIAL 
LEARNING THEORY OF CAREER DECISIONMAKING 

The following propositions and illustrative hypotheses 
are concerned with factors which influence CDM skills, and 
are excerpted from Krumboltz's (197'?) social learning theory 
of career decision making. 

"CDM skills are a subset of task approach skills pertinent 
to occupational and educational decision making. Propositions 
in this section attempt to explain how these particuoar skills 
are acquired. 

Proposition IIAl i An individual is more likely to learn the 
cognitive and performance skills and emotional responses 
necessary for career planning, self-observing, goal setting, 
and information seeking if that individual has been positively 
reinforced for those responses. 

Illustrative Hypothesis. High school students who are given 
a structured course in decision-making skills and whose 
efforts in that course are consistently rewarded and never 
punished will be more likely to apply those decision-making 
skills in future decision problems than will those high 
school students not receiving such a course. 

Educational institutions may well be able to influence 
the degree to which people learn how to take control of 
their own career decisions. CDM is not exclusively the 
result of events happening to an individual but can also 
be shaped by an individual's own actions. But people need 
to know what kind of actions are likely to have some 
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positive results for them* Systematic instruction can be 
designed to increase the probability that people can 
formulate and select intelligently from options that are 
presented to them or that they may have designed for 
themselves. 

Pro-position IIA2 i An individual is more likely to learn the 
cognitive and performance skills and emotioanl responses 
necessary for career planning, self-observing, goal settingi 
and information seeking if that individual has observed real 
or vicarious models engaged in effective decision-making 
strategies. 

Illustrative Hypothesis i Students who observe a CDM film 
in which the models are depicted as being positively 
reinforced for engaging in the process will be more likely 
to engage in a similar process than will students not 
exposed to the same film. 

Films I books, television programs, as well as the 
opportxinity to observe real people wisely engaging in 
decision-making activities can probably have a great deal 
of influence on the extent to which young people will learn 
decision-making skills themselves. Experiments can be 
designed to determine tAc exact nature of such experiences 
that will make them most effective for youngsters of various 
backgrounds contemplating decisions of various types. 
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ProTDOsition ILM > An individual is. more likely to learn the 
cognitive and performance skills and emotional responses 
necessary for career planning* self-observing, goal setting, 
and infornnation seeking if that individual has access to 
people and other resources v/ith the necessary information. 
Illustrative HvT30thesis : Students in schools that set up 
procedures for making career information easily accessible 
in meaningful ways will develop CDM skills to a greater 
extent than will students in schools not providing such 
opportunities . 

Educational environments which provide needed CDM 
resources will probably produce superior decision-making 
skills. However, the resources need to be tailored to the 
entering skill level of the students and need to be made 
interesting and pertinent to the target population. Resource 
include not merely descriptive materials about occupations » 
but simulated job experiences, opportunities to talk v/ith 
people engaged in various occupations, and even opportunities 
to work for short periods of time in close association with 
people in various occupations . 
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APPENDIX C 

STUDENT'S workbook: A SEVEN-LESSON CAREER DECISION TRAINING PROGRAM 




STUDENT'S WORKBOOK 



DECIDES: A Seven-lesson Career 
Decision Training Program 



Daniel A. Hamel^ 
School of Education 
Stanford University 



The author acknowledges the contributions of Cathy Dough'^r, Richard 
Kinnier, John Krumboltz, Stephanie Rude, Dale Scherba, and Elizabeth 
Snowden in developing materials for this curriculunn Graphics and line 
drawings were done by Elizabeth Zack. 
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Lesson //I 



INTRODUCTION 




You are beginning* a program chac is designed Co help you make 
beccer decisions. All of us are faced wich many decisions each day. 
For instance, you probably had Co make some choices abouc whac Co 
wear coday, whac co eac for breakfasc, how Co gee co school, and 
whecher or noc co accend chis class. These decisions were probably 
fairly easy for you co make. In face, because such choices are so 
common and roucine, you may noc chink of chem as decisions ac all. 
However, decision making occurs whenever a person seleccs from Cwo 
or more possible alcernacives. 

As you chink abouC decisions you have made, you become aware 
chac some were much easier Co make chan ochers. For example, decid- 
ing whac Co have for lunch yescerday was probably less difficulc chan 
deciding which classes Co cake chis semescer. Can you chink of ocher 
decisions you've been faced wlch recencly chac were hard Co make? 

Imporcanc decisioits usually presenc us wlch che biggesc problems. 
Choices chac involve our relacionships wlch family members and ocher 
imporcanc peopl(>, our educacion and craining, where we live, and how 
we spend significanc amouncs of our clme and money are hard Co make. 
We realize chac decisions like chese ofcen have imporcanc long-range 
consequences. Somecimes jusc chinking abouc important decisions 
nakes people so anxious chac chey eicher wane Co avoid chem alcogecher 
or make chem very quickly. 

The purpose of chis course is co ceach you how co make imporcanc 
decisions wich greacer confidence. You'll be learning a syscemacic 
procedure for making complicated decisions easier co manage. You 
will be given a number of opporcunicies Co practice a series of 
simple seeps on decisions chac are presenely important to you. 
We'll be paying special attention to the concerns people have when 
making decisions about their careers. In other words, how do people 
make "choices about courses to take, parttime and surcier jobs, which 
colleges or training programs to apply to, and what kinds of work 
they hope to be doing? 

Career decision making- is important, and it can be frustrating 
-if you don't know how to do it. During the next few weeks you'll 
learn about some actions vou can take to solve vour decision problems. 
Oft en just describing the decision you want to make and giving your- 
self a time limit can be very helpful. Too often people try to make 
decisions without being aware of what is important to them. We'll 
spend some time finding different ways of getting in touch with what 
we most value or want to obtain when decisions have to be nade. 

We'll also look at ways to become aware of our options in a 
decision situation, and how to use inf orrr.ation to discover whac might 
happen if we choose a particular alternative. We'll also examine a 
procedure for eiiminacing our options until arriving ac the most 
promising one, and then putting that choice into action. Now, if all 
chis talk about alternatives, va'ues, and using infomacion seems con- 
fusing, don't be concerned. All of chese ropics will be discussi^d many 
times during cur weekly meetings, and you'll have plenty of practice in 
trying them out. 



105 




INTRODUCTION 



(Contd) 



One final point: es you begin to learn a process for making 
decisions, you'll probably find that you have many more worthwhile 
possibilities to explore for your important -decisions than you 
were ever aware of before. Learning decision-making skills gives 
you added freedom and control over your life because it increases 
the range of options you are able to consider. By applying good 
decision-making skills, decision problems become less troublesome 
and we are more likely to be satisfied with the choices we make. 
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The dec ides Model 

St£P Activity 

1. Define the problem. 

2. Establish an action plan. 

3. Clarify values. 

4. bentify alternatives. 

5. Discover probable outcomes. 



5. Eliminate alternatives systematically. 



7. Start action. 



Notice that Che first letter of the first word 
in the above seven steps spells DECIDES as you read 
down the page. This is a handy way for you to recall 
the suggested activities and their order when using 
this model to make important decisions. 



From: Krumboltz, J.D. and Haiu>::. , >. . A. Guide to career decision-making 
skills . New York: The College Board, 1977. 
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The DECIDES Method; Definitions & Examples 



!• Defining the problem means to 

Describe the decision you must make and name the date or 
time by which it must be made. 

Examples: 

"I have to decide which class to take 3rd period b^ Monday." 
"I want to decide on a parttime job within the next 3 weeks." 

2. Establishing an action plan means to 

Describe the actions you'll take to make the decision. 
Plan when you'll do each activity and estimate how much time 
each step will take. 

Example : 

"Before choosing a parttime job, I'll spend a couple of hours talking 
to my friends and neighbors and at least three afternoons looking at 
local job listings in both the newspaper and the State Employment 
Service. Then I'll give myself 10 days to check out the possibilities 
and get any more information I need before deciding. I'll apply for 
at least one job by March 9th." 

3. Clarifying values means to * 

Specify the features or benefits that are important for you 
to have or experience in your choice. 

Examples : 

"I want a job that pays at least $3 per hour and lets me work 
outdoors." 

"I want a car that gets good gas mileage (22+ M.P.G.), has front 

wheel drive, rides very smoothly, and costs less than $5,000." 

4. Identifying alternatives means to: 

Specify two or more choices or options in a decision situation. 

Examples : 

"I'll list four jobs which pay at least $3 per hour and let me work 
outdoors: gardener, lifeguard, window washer, and parking lot 
attendant." 

"I'll examine some cars which meet ray criteria. So far I want to 
consider Che Ford Fenderbender, the Plymouth Rock, and the Toyota Goyta. 
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The DECIDES Method: Definitions & Examples 



(Contd) 



5 • Discovering probable outcomes means to 

Evaluate how well each alternative would provide the 
features or benefits you want in your choice. 

Examples: 

"I test drove three cars yesterday and found out how each one handled.' 
"By talking to some salespeople, I found out how much each car would 
cost with the features I want." 

"I talked to my friend, Diane, to find out what it was like for her to 
be a lifeguard at the city pool last summer." 

6. Eliminating alternatives systematically means to 

Compare your alternatives to each other until you find the 
one which appears to give you most of what you really want in your 
choice. In other words, you want to compare your options until 
you find the one that best satisfies your values. 

Examples : 

"I've dropped gardening from my list of summer jobs because I can't 
find any work that pays more than $2.65 per hour. I'll look more 
closely at my remaining alternatives;" 

"I had to eliminate the Ford from my list of possible cars because the 
model I wanted cost $700 too much, and the Plymouth that met my other 
criteria only gets 20 miles per gallon. That means that either I'll 
buy the Toyota or find some new possibilities." 

7 . Starting action means to 

Act on your decision by doing whatever Is necessary to 
obtain your desired outcome. 

Examples: 

"I submitted two applications to be a parking lot attendant, and next 
Thursday I'll be interviewed for a lifeguard job." 
"I have an appointment at 3:30 this afternoon with a loan officer at 
my bank to discuss a financing plan for the car I've decided to buy." 
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The DECIDES Model: An Illustration 



Although you probably wouldn't spend a lot of time making a 
simple decision like deciding which book to read tonight, the follow- 
ing example demonstrates how our DECIDES method could be applied to 
a typical decision situation. 

Planning 

Steps Example 

"I want to pick one book to read tonight 
and make my decision within 5 minutes." 



1. Refine the problem 
(a) 

( the desired accom- 
(b) 

plishment, the time 



limit) 



2. Establish an action plan 
(the activities you expect 
to perform to reach your 
decision) 

To clarify values. 

To identify alter- 
natives. 

To discover probable 
outcomes. 

To eliminate alter- 
natives systematically. 

To start action 



"I'll list what I want the book to do 
for me." 

"I'll consider unread books on my 
bookshelf." 

"I'll read the first page of certain 
books." 

"I'll discard unsatisfactory books one 
by one until I find the best." 

"I'll begin reading/' 



Carrying Out the Plans 



3. CJ^rify values 

(hoped for benefits) 



4. Wentify alternatives 
(list possible choices) 

5. Discover probable outcomes 



Eliminate alternatives 
systematically 

Start action 



"I want a book that is (1) short, 
(2) light and entertaining, (3) a 
detective story, and (4) easy to 
read." 

"I'll consider these 5 books." 



"I'll make a grid to see which books 
satisfy my values." 
"I'll read the first page of certain 
books. Ugh, this one is boring." 

"I'll discard this book because it's 
too long." 

"Now that I've found the best of all 
available books, I'll start reading.* 
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JIM'S SUMMER JOB 



This is a story about how one person uses the "DECIDES'' model 
to make a particular decision. Jim is a high school junior in 
Palo Alto who is deciding on where to apply for summer jobs. 

Read how Jim begins his decision-making process. You will be 
asked later to help him finish it. 

Jim's problem is familiar to all of us. Think about your own 
experiences as you read. How would your approach to the problem 
be similar and how would it be different? 



It is now February and Jim wants to decide what summer jobs 
he should apply for. Although he senses that this may not be 
one of the most important choices in his life, he wants to make 
it carefully. If he chooses a bad job, he will not ruin his 
life, but he realizes a poor decision could make his summer vary 
unpleasant. 

Last year Jim spent only 5 minutes making a decision abouc 
a summer job. June crept up on him and all of a sudden he need- 
ed a job immediately. Otherwise, his mother would be nagging 
him every morning until he found some work. So when a friend 
mentioned that a local supermarket was looking for cashiers, 
he went right down there and was working the next day. 

Jim paid for his hasty decision. It was a boring summer 
for him. He strongly disliked being indoors all day, standing 
'in one place, and listening to irate customers. "This summer 
I will make a better job choice," he resolved. 

Jim discovered that a course in decision making was being 
offered at hi.** high school. He wondered if he could use the 
course to help hin make a. good decision on what jobs to apply 
for this summer. He reasoned, "I ruined my last summer 
because I jumped into something without any thought % I'm 



How impor- 
tant is 
the decision? 



What are the 
consequences? 



An impul- 
sive decis- 
ion that 
turned out 
poorly 
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JIM'S SUMMER JOB 



(Contd.) 



sure that I could have made a better decision that would 
have resulted in a more satisfying summer. Maybe this decision- 
making training will help. I'll give it a try." 

After the first class, Jim looked over the decision- 
making steps. 

Define the problem 

Establish an action plan 

Clarify values 

Identify alternatives 

Discover probable outcomes 

Eliminate alternatives systematically 

Start action 

It made sense to him to use these steps for his summer 
job decision. He imagined that he might use the model even 
more extensively if he was deciding about long term employ- 
ment. However, if he was deciding what kind of coat to buy, 
he would probably use the steps less extensively, and in 
choosing what to eat for lunch, he wouldn't use them at all. 

Jim was also prepared to use the model in a flexible 
way. For example, if while he was "Identifying alternatives", 
he felt that some of his values were still unclear, he would 
recycle back and spend more time clarifying his values. 



Know when 
and how 
to use the 
model* 



Use the 
model in a 
flexible 
way. 
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DECISIONS THAT I MAKE 



Look over your "Personal Decision Log" listings as you enter 
them in the last section of this Notebook , - For now, try separating 
them into fairly routine, day-to-day decisions in one group, and 
decisions that seem more important into another. 





Some Routine Decisions 


Some Bigger Decisions 


1. 




• 1. 


2. 




2.' 


3. 




3. 


4. 




4. 


5. 




5. 


6. 




6. 


7. 




7. 



Can you list some other "big" decisions that you've made recently 
or will be facing very soon? 



You might want to use the above "Bigger Decisions" list to help 
you find the decision problem you want to work on for the rest of 
*this course. Remember, you are to write a brief description of that 
decision between now and our next class. It should be an important 
decision about your plans after graduation ,frora high school, and 
might involve college plans, where you'll live, whether or not you 
want to find a job, what kind of work you'd like to do, etc. 
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DESCRIBING MY DECISION 



Week 1 



I. A major decision I must make within the next year 



115 



131 



Decision to be Made 



Uy when? 




Mow 

Importnnt? 
I.- 10 

10=vcry ' 



AltcrnnLlv 
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Flnnl Choice 



IIovnt 

S.'il ls( UmI? 
I-M) 



(iOIUIUfllt 
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Lesson //2 



Define Che Problem 



JIM'S SUMMER JOB 



(Coned.) 



This strep was rather easy for Jim in this particular 
situation. Often, however; a person may feel there is a 
need to make some kind of decision, but have difficulty in 
expressing it clearly. A couple of years ago, Jim went 
through a period where he did not feel very happy. He 
felt that there must be some decisions that he should make 
but didn't know where to begin. 

After much thinking and talking to others, he 
realized that he had not been engaging in any enjoyable 
activities for some time. Following this realization, 
he could then state an appropriate decision to be made 
•in clear terms. 

At the time he told himself, "I want to find several 
spare-time activities that will be enjoyable to me. I 
plan to come up with a list of ''enjoyable activities" by 
September 1st." Without realizing it, Jim had made an 
important first step toward a good decision. These days 
Jim knows how to enjoy himself. 

As mentioned, Jim actually had little difficulty 
in defining his current problem. After a little thinking, 
he wrote down: 

"I will come up with 3 interesting summer job pos- 
sibilities chat I will apply for by May 1st." 



Identify a 

problem 

situation. 



State a 
problem in 
clear terms 
with a ten- 
tative time 
table . 
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Table 4 



Information About CDM Skills Training Program Instructors 



English Class(es) 
Instructor" Students. Assigned From Sex -Age 



Class 1 English IIIC F 21 
Period 1 

Class 2 English, IIIC M 30 



Education 



Previous Secondary School 
Counseling Experience " 



College Senior 
• Psychology Major 

2nd yr.. Ph.D. Candidate 
Counseling Psychology 



None 



None 



Class 3 English IVC 
Period- '3 



Class 2 English IIIC • M' 



32 4th yr. Ph.D. Candidate 
Counseling Psychology 



3 years 



Class 3 English IVC 
Period 3 . 



Class 4 Orientation to 
' College 
Period 4 



M 28 ■3rd yr. Ph.D. Candidate 
Counseling Psychology 



l.year 



39 



40 
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BANK BROCHURES 



- Bank A - 

We at Bank A pride ourselves on providing fast and friendly service,. 
For your convenience we offer: 
* a drive-up window 
a special "no-bounce" checking plan 
special weekend hours - we are open until 9:00 p.m. 
on Fridays and 9:00-12:00 on Saturdays 
unlimited checking - write as many checks as you 
want for just $2.00/mo. 

COMMENTS: 5 people in line. 

1 mile frcm my home 
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- Bank B - 

It is a pleasure to serve you with a checking account at Bank B. 
At Bank B you will find a special checking account to fit your 
personal needs. If you usually write less than 30 checks per 
month you will like our "economy plan". There is no monthly 
service charge — you pay only 5^ for each check you write. 

We also offer long banking hours for your convenience. We are 
open until 9:00 p.m.. Fridays and from 9:00-12:00 Saturday mornings. 

COMMENTS: 4 people in line 

3 miles from n\y home 
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- Bank C 



Come to a bank you can count on. We at Bank of C are experienced 
in the field of banking. We think you will like our special 
services, too. We provide free checking accounts with no 
minimum balance requirements. We know that time is important 
to you. That's why you'll find branches of Bank C all over 
California, and every branch is open until 9:00 p.m. on Friday 
nights* 

COMMENTS: 14 people in line 

3 miles from ny home 
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BANK VALUES GRID 



Values 



1) Low Charge 
for Service 



Values In Question 
Form 



1) How much does checking 
account cost? 



2) Quick Service 



3) Close Location 



») Extra hours on 

Friday or Saturday 



2) How many people were 
standing In line? 



3) How close Is bank 
to my home? 



4) What are the bank's 
hours on Friday or 
Saturday? 



ALICE'S PR03LEM 



Dlrecclons ; Interpret and discuss che following brief passage wich 
one or cwo ocher people in our class. Then see if you can agree on 
one or more good ways of "defining che problem" facing Alice, Vrice 
your problem def inition(s) in che space ac' che boccom of chis page. 



Alice seems- to be walking in a daze becween her 5ch and 6ch 
period classes, Alchough ic's Thursday afcemoon and she'd normally 
be geccing exciced abouc her plans for che weekend, she feels confused 
and uneasy, 

Alice has been dreading che weekend because she needs Co spend a 
loc of cime working on a hiscory paper due nexc Wednesday, However, 
yescerday her friend, Karen Brown, inviced her Co spend Friday afcer- 
noon and all day SaCurday skiing wich che Browns ac Cheir Lake Tahoe 
cabin. 

This ski crip seemed like a greac opporCuniCy, buC Chen jusc an 
hour ago ac lunch Pac had inviced her Co a fancascic parcy on Friday 
nighc, Whac should she do? 

Karen was a loc of fun, and chis mighc be her only chance Co go 
skiing all year. If she wenc on Che ski Crip, she'd miss Pat's parCy 
and anocher hiscory class Friday afcemoon. The hiscory paper would 
be almosc half her grade chis quarcer. She wondered if che paper 
would bewriccen on time since she scill had quice a bic of reading 
CO do before she could start writing it. 
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LET'S GET SPECIFIC 



Listed below are five vague and unclear statements referring 
to decision problems. Change each statement into a more clearly 
defined decision situation. Remember that almost any given decision 
problem can be defined in a number of different ways. 



Example: 



I wish I could figure out how I'm going to spend Spring vacation. 

Spring break begins in just five weeks. Three weeks from today I 
will have investigated some possibilities and make a decision about 
how and where I'll spend that period of time. 



1. I want to get the best job I can. 



2. I need to find some good classes. 



3. Pretty soon I will find something to do this Summer. 



4, I should change my life before I get much, older. 



5. I have to decide about the future. 



^."^hich of the above statements is your best effort at writing a 
clear problem definition? wTiat makes it better than the others? 
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DEFINING MY DECISION PROBLEM 



Week 2 



II, Now that you've had some practice In defining problem 

situations more clearly, what might be a better way to 

"define the problem" for the major decision situation(s) 
you described last week? 
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Lesson //3 
Establish an Action Plan 



JIM'S SUMMER JOB 



(Contd.) 



Establish an Action Plan 

An action plan is a tentative guide for all the steps 
between the definition of the problem and the actual carrying 
out of the decision. It helps in organizing and spacing ac- 
tivities so that the decision proceeds smoothly and on a 
schedule, 

Jim sat down and wrote out his plan of action with ten- 
tative deadlines that seemed reasonable. With each step he 
asked himself, "What actions can I take to successfully 
complete this step?" 
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JIM'S SUMMER JOB 



(Coned.) 



Action Plan - Summer Job 
Clarify Values (by March Ist) 

Identify Alternatives (ty March 20th) 



Discover Probabie Outcomes (by April 1st) 



3. 72l24 /iz^^-^c, ^r^^^ -^--^ ^j-^ 
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JIM'S SUMMER JOB 



(Contd.) 



Eliminate Alternatives Systematically (by April 15th) 

Start Action Qjy May Isti 
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.A SAMPLE ACTION PLAN ^ 



Action Plan for . 



foul 



Career Decision Making 

Today's Date: 



Steps 



Actions 



Completion Date 



1. Define the problem 

2* Establish an action plan 

3. Ciarify values 

4. Identify alternatives 

5. Discover probable outcomes 

6. Eliminate alternatives systematically 

^^J!rze^ Ai^^njZi^ru^f^ a^SlffuiZZv^ j^Ka^7i&;i*^^ 
7* Start action 



^Froni: Krumboltiz, J.D. and Hamel, D.A. Guide to career decision-making skills . 
New York: The College Board, 1977. Used by permission of the College Board. 



Usttheipccirit 
^tcliioAs you 
mu\\ (0 rcacn 
andUt* WQcl 
daKSby which 
ycu will recti 
Utem. 



Lbt Actions anc 
dca4Un« dates 
fof 

•ccompJtshlng 
tactistcp* 



Us I accMtks 
ttutwiU h<ip 
yoM discover an 
statt whaCyoii 
rutiy want fron 
ytMtf decision. 



List possible 
actions mat win 
help you nnd 
some 

appro pdace 
opportunfUej. / 
counselor, 
ref cf erKC booiu 
and your own 
Iriu^ination can 
suggest some 
possible 
alternatives. Us 
your own 
current skills. 



Use any source 
of (nformaUon o 
experience that 
will help you nm 
out what an 
atteniaiivt 
would be like for 
yott. 



Kcviseyourptar 
as yougoalon^. 
Each new 
experience )ou 
have may 
surest other 
alternatives or 
actions to you. 



After evaluating 

jrour 

information, gel 
rid of the least 
desiraoic 
alternaitvcs 
nrsu Thenfc* 
evaluate those 
remaining. 



Ptantouke 
action. A 
decision ftasn t 
been ma<sc until ' 
you do 

somc'Jtlng abou* 
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ACTION PLAN for my "big" decision 



Week 3 



III. Some actions I can Cake to simplify the decision I want 
to make. 



Steps (Actions — you fill in) 



Completion Date 



Define the problem (copy from last week's exercise) 



Establish an action plan (you're doing that now) 



Clarify values (what actions can you take to learn 
what's important to you in this decision situation?) 



Identify alternatives (what can you d£ to find 
some options?) 



Discover probable outcomes (what can you do to find 
out what choosing each of your options would be like?) 



Eliminate alternatives systematically (how can you 
narrow your alternatives down to the best possible 
choice?) 



Start action (what actions will you take to niake 
your decision happen?). 



130 



Lesson //4 
Clarify Values 



JIM'S SUMMER JOB 



(Contd.) 



Clarify Values 

Jim began this step on a Saturday- In March. That 
afternoon he reviewed his past jobs and activities in light 
of his values. 

His first job was mowing lawns. That was 6 years ago. 
He thought about what he liked and disliked about it. For 
one thing, he liked working outdoors and the physical exer- 
cise. He valued working in the clean air and sunshine and 
got a sense of accomplishment from seeing a yard well cut. 
He liked working independently. He did not like the respon- 
sibility of having to repair broken equipment. 

Last summer he discovered several other things he did 
not like. At the end of each day he felt exhausted from 
ringing the cash register. He often wondered why just 
pressing keys tired him out more than pushing a lawn mower 
.•all day . Now it seemed clear to him. It was the boredom 
that tired him. The endless stream of cash receipts did 
not satisfy him as much as seeing a freshly mowed lawn. 

To further clarify his work values, Jim made a point 
of asking others what they looked for in 'summer work. Of 
course, many people mentioned things he did not find impor- 
tant. His best friend, Ralph, for example , cited "having 
Fridays off" as one of his highest values. Last summer 
Ralph worked in a job that he did not like just because it 
was easy to get Fridays off there. ~;Jini -chought Ralph 
had niade a foolish choice. 



Identify the 
benefits or 
features you 
most want to 
have in your 
choice. 
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JIM'S SUMMER JOB 



(Contd.) 



One of Jim's teachers said something that made sense to him. 
She reminded him that if he was going to go to college after 
graduating from high school, he would be needing quite a bit of 
money. Thus, another value for summer work was "making a good 
salary". 

Jim gathered up all his notes from speaking to people and 
reviewing his values in past jobs. He wrote down the following 
list and ranked each value in order of importance. 



3 ^jjtiZ^ pM^^cjUuii^ j^jltkX^ 
5- TVItrr^^ }J.^^tLc^ 
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Some Work Values and 
What They Mean 



^^^If^ represents Che extent to which you can enter an occupation 
quickly without spending much time preparing for it. 

vfr^°?LM'"^f ^ "''^^ ^"'^'^y' '^^^ b^Si" With 

±n7±n . « training in advance. You can begin earn- 

ing income right away. 

If your occupation has low early entry, you will have to spend 
many years in training or education. You will be delayed longer 
than most in beginning to earn your own living. 

Hel£i|s Others is the extent to which you directly help people face-to- 
face as part of your occupation. 

If your occupation offers a high opportunity to help others you 
would spend most of your time working directly with people to 
improve their health, education, or welfare. 

If your occupation offers a low opportunity to help others, you may 
do work that is indirectly useful to others without seeing those 
who benefit, and/or your primary loyalty is to your employer (or 
your own self-interest). h r (.or 

Income is the amount of money you earn in an occupation. 

If your occupation offers high income, you would earn much more 
than you would in most other occupations. 

Low income means you would earn less than you would in most other 
occupations, though still enough to live on. 

Independence is the extent to which you make your own decisions and work 
without supervision or direction from others. 

bLr"'^ occupation offers high independence, you would be your own 

independence would mean working under close supervision carry- 
ing out the decisions of others. 

Leadership is the extent co which you guide others, tall chera what to do 
and are responsible for their performance. ' 

If your occupation offers hiah leadershio, you would direct activi- 
ties and influence people. You would also accept resoonsibilicv 
tor the pertormance of the people you direct. 

With low leadership you would not direct other peoDle and vou 
would not be responsible for their performance. 
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Some Work Values and 
What They Mean 



(Contd) 



Leisure has to do with the amount of time your occupation will all 
you to spend, away from work. 



ow 



In an occupation which has high leisure, you will have short 
hours, long vacations, and the chance to choose your own working 
hours . 



With low leisure you will often work long hours, perhaps nights 
and weekends, with short vacations and limited choice of hours. 



Prestige is the degree to which an occupation commands respect in 
people's minds. 

An occupation with high prestige is one which most peopV-i look up 
to. 

An occupation with low prestige is one which does not command general 
respect. 



Security concerns the degree to which your occupation and Income are - — 
protected from hard times or new labor-saving inventions. 

With high security you would be reasonably sure of keeping your job 
arid income. 

With low security you might easily lose your job and Income. 



Variety concerns the' extent to which your work activities involve you in 
doing different things, in different places, with different people. 

If your occupation offers a high amount of variety, you would find 
yourself frequently doing different kinds of things, interacting with 
many different people, and/or working in many different places. 

Low variety would mean doing mostly routine and repetitious work 
with the same co-workers in the same place every day. 
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The Fall-Out Shelter Problem 

PURPOSE 

"This is a simulated problem-solving exercise. It raises a host of 
values issues which you must attempt to work through in a rational 
manner. It is often a very dramatic example of how our values differ; 
how hard it is to objectively determine the 'best 'values; and how we often 
have trouble listening to people whose beliefs are different from our own. 
PROCEDURE 

The class will be divided into groups of four, who then sit together. 
You will work on the following problem; 

Your group are members of a department in Washington D.C, that is in 
charge of experimental stations in the far outposts of civilization. 
Suddenly the Third World War breaks out and bombs begin dropping. Places 
all across the globe are being destroyed. People are heading for whatevsr 
fallout shelters are available. You receive a desperate call from one 
of you experimental station3, asking for help. 

It seems there are ten people but there is only enough space, air, 
food, and water in their fallout shelter for six people for a period 
of three months - which is how long they can safely stay down there. They 
realize that if they have to decide among .themselves which six should go into 
the shelter they are likely to become irrational and begin fighting. So 
they have decided to call your department, their superiors, and leave the 
decision to you. They will abide by your decision. 



Copied from an exercise in - Values Clarification by S.B. Simon, L.W. Howe, 
and H. Kirschenbaum. New York: Hart Publishing Co., Inc., 1972, 
pp. 281-286. 
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But each of you has to quickly get ready to head down to your own 
fall-out shelter. So all you have time for is to get superficial descriptions 
of the ten peoplie. You have half-an-hour to make your decision. Then 
you will have to go to your own shelter. 

So, as a group you now have a half-hour to decide which four of the 
ten will have to be eliminated from the shelter. Before you begin, I want 
to impress upon you two important considerations. It is entirely possible 
that the six people you choose to stay in the shelter might be the only 
six people left to start the human race over again. This choice is, 
therefore, very important. Do not allow yourself to be swayed by pressure 
from the others in your group. Try to make the best choices possible. 
On the other hand, if you do not make a choice in a half-hour, then you 
are, in fact, choosing to let the ten people fight it out among themselves, 
with the possibility that more than four might perish. You have exactly 
one half-hour . Here is all you know about the ten people: 

1. Bookkeeper; 31 years old 

2. His wife; six months pregnant 

3. Black militant; second year medical student 

4. Famous historian-author; 42 years old 

5 . Hollywood s ta^'let te; singer; dancer 

6. Bio-chemist 

7 . Rabbi; 54 years old 

8. Olympic athlete; all sports 

9. College co-ed 

It 

10. Poll ^ with gun (they cannot be separated) 
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List ac lease chree significant people in your life who you 
admire. These people mighc include a close friend, relative, coach, 
famous personality, or teacher. Why do you like them? '"nat are 
their most important values as you see them? 

Pick one of these three people to interview. Try to find out 
how this person became aware of his or her values and how he or 
she describes them. 



Some PeoDle I Admire 


Their Values 




likes to help people, very 
independent, greatly enjoys 
his leisure time 




Mr. Hayes, Soph, math teacher 


1. 




2. 




i 

i 
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Imagine that it is the year 2040 and your long life has just ended. 
A group of people has gathered Co cotimemorace whac you represented Co 
chem. 

Think about how you would like Co be remambered. Vhac values would 
you like people to associate wich the way you lived? What do you want 
chem Co believe was imporcanc co you in life? 

Complece che following remarks (using 2 or more sencences) made by 
people who knew you well. 

1. One of your high school English Ceachers recalls whac you valued 
mosC as a scudenc. 

"She (he) was . . . 



2. Your supervisor from your firsc job afcer you finished school 
commencs on whac ic seemed you wanced from life. 

"By che way he (she) worked, ic seemed chac . . . 



A group of co-workers from che various jobs you've held agreed 
chac you scrived Co achieve cercain common goals, regardless oi 
your vork seccing. 

One of chem summed ic up chis way, "Yes, I can scill remember 
how imporcanc ic vas co her (him) co . . ,. 
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YOUR EPITAPH 



(Contd) 



Several lifelong friends recall events that seem to reflect th 
things you most enjoyed and strived to achieve. 

One of them says, " 



Now look over the statements made by each of these four people 
List each value that was mentioned. 

1. 

2. 

3. 

A. 

5. 

6. 

7. > 

8. 

9. 



Think about each value and what it means to you. Narrow 
the list down to the four or five that you consider are your 
most important work values. 

1. 
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MY VALUES 



Week 4 



IV. Some benefits I hope to gain in making this decision. 
In other words, a list of my value preferences that 
are important in making this choice: 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
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Lesson //5 




IDENTIFYING ALTERNATIVES FOR JIM'S SUMMER JOB 



For the past few weeks you've been reading about Jim, a student 
much like yourself, who is thinking about what he wants for a summer 
job. From your general impression of Jim and what you've learned about 
him so far, cry to list at least six jobs he might consider. 

Remember, as you discuss Jim's prospects in your group, brainstorm 
some possibilities that actually exist in the Palo Alto area. 



3. 



4, 



6. 
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MY ALTERNATIVES 



Week 5 



V. Some alternatives I have found: 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 



Alternative 



Information Source 



What resources did you use to discover these options? 
Books or catalogs? Talking to people? Radio or TV? 
Your school's Career Center? Which sources were most 
helpful? 
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DISCOVERING PROBABLE OUTCOMES FOR JIM'S SUMMER JOB 



CU 



^' into TJ J' "T. ; ^'l' '''' important work vnlue.s, Find those v.luo. nml 

write them under the colunm labeled "Values^' below. The first one is already listed, 

^' done'for yo^''^^^" ''''' ''^ ' J''" '^^'^"^ ^'^^ ^^^^^^ ^^'^^^ 

I'Li^lJemf H '''' "''^ ^'^^ "Alternatives" 

^' [!id\^eIor'" '''^ alternatives by filling in all of the boxes h tho 



Alternatives 



D 

to 
n 

0 

< 
n 

ri (D 
0 .0) 

cr m 

D3 0 

cr 3 

H 

ON 

0 

c 

rt 

n 

0 

3 
(B 
{0 



Values 


Value 
Questions 


1 


2 


3 


4 


5 


6 


1, 0^*4**^. 
















2. 
















3. 
















4. 


•f 














5. 
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DISCOVERING PROBABLE OUTCOMES for my ''Big" Decision 



Week 6 



VI, You are now ready to start investigating the alternatives . 
that you listed. Remember, the idea here is to try and 
find out as best you can what it would actually be like to 
experience each of your options. Use the values you listed 
for Exercise IV to ask questions that will guide your search. 
Use the information you gather to fill the spaces in the 
grid below: 



ALTERNATIVES 



Value 


Value 


1 


2 


3 


4 








































t 










■ i 






i 
1 

1 

i ! 


i 


1 

1 
1 
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Lesson //7 

Eliminate Alternatives Systematically 
and 

Start Action 



ELIMINATE ALTERNATIVES FOR JIM 



Now that you've had a chance to see how well each of Jim's 
alternatives satisfies his values, .try to eliminate the three 
least favorable summer jobs for him. 

Start by crossing out the least attractive option (you 
can actually do this on your values/alternatives grid sheet). 
Which alternative would you eliminate next? And next? 

Now, list the three remaining jobs that you think Jim shou 
apply for. 



2. 
3. 



1G3 
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ELIMINATING ALTERNATIVES for my "BIG" DECISION 



Week 7 



VII, -Now that you've filled in a grid with some information 
about how well each of your alternatives satisfies each 
of your personal work values, you can begin eliminating 
some of your options. 

Which alternative can you eliminate first? 



And next? 



How will you arrive at what seems to be your best 
choice or choices? 



What will you do next? 



1A7 
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APPENDIX D 

MASTER LESSON PLANS FOR UNITS 1-7 OF A CAREER DECISION TRAINING PROGRAM 



LESSON PLAN 

Session //I: Overview February 28, 1979 

! GO EASY TODAY!! This first class 
is a chance to becone acquainted, build rapport, and set a positive 
tone for subsequent sessions. 



Objectives ; Por this first group meeting, you'll have about ^5 
minutes to accomplish three things i (l) introductions, (2) distribute 
v/orkbooks and provide an overvie of the program, and (3) introduce 
the DECIDES model. 



Kethodsi 



I. Getting Acquainted 

A. Take roll — we're required to do this for every class 

B. Introduce yourself 

1. Sketch your background, interests, and what you're 
presently doing— the kids want to know about this 

C. Ask students to introduce each other 

1. Emphasize that we're beginning a nev; program together, 
and that much of what we learn will be through shared exper^ 

2. Divide group .into pairs. Ask them to chat for 2 or 3 
minutes, and try to learn something interesting about the 
other person. 

Note: (a) If odd number of students present , instructor 
should pair up -with one of the students, 
(b) If you have a"favorite "ice -breaker" exercise, feel 
free to substitute it for the one above or add here. 

II. Overview of the Curriculum - 
A. Distribute workbooks 

1. Allow kids several minutes to thumb through 

2. Emphasize we'll only be using a few pages each week 
3. Mechanics of program 

1. Meet here every Wednesday at this time for next 6 weeks 

2. Attendance required — roll will be taken and reported, 
just as in other classes 

3. Stress importance of regular attendance—most of the 
work we do will take place in class— -only wa\| to. really 
learn the material 

C. Contents of programi 3 parts 

1. Assigned reading; very little of that — most of it 1st week 

a. Jim's story — 1-3 pages each v/eek 

b. Occasional definitions and examples to explain the 
exercises 

2. Things you do in class — mostly group discussions about 
decision-making experiences, but several exercises as well 

3. Things you do outside of class t Homework 

Host of this will be fun and take very little time, but it 
will be important to get done, h 
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LESSON PIANi Session #1 (cont) 



III. General Points 

A. Focus v/ill be on your personal decisions. A chance to 
learn a process for taking action on your ovm decision 
problems here and now. 

B. We'll be learning one method for approaching decision tasks 
Remember that it may be a new procedure for you, and may not 
even be the best way for you to make decisions. Give it time. 
Our real goal is to gain some experience with this method, 

and find the kinds of decision situations v/here it seems to 
work best. 

C. There probably is no one best way to make decisions. It is 
important for you to realize that most people have' real 
difficulty making at least some of the important choices in 
their lives. 

I'll be sharing some of the iDroblems and frustrations that 
I've experienced with my own decision-making. I hoDe you'll ' 
do the same. V/e can all learn a great deal by seeing how 
others cope with decisions similar to our own. 

IV. IfeLte rials 

A. Assign introductory reading (8 mges) 

1. "Introduction" (2 pp) 

2. "The DSCID2S Model" 

3. "The DECIDES Kethod: Definitions and Examples" (2 pd) 
^. "The DECIDES Model t An Illustration" 

5* "Jim*s Sturaner Job" (2pp) 

B. Homework exercises 

1 . "Decision Log" 

a. Provide several sample entries in class. Ask 
them to record one of these for future reference. 

2. "Decisions That I r^'aJce" 

3. "Describing Decision" 

a. Emphasize importance of this choice — i.e. this 
decision problem will be worked on for the rest of 
this course. 

V. Introduce DECIDES model 

A. Use poster for quick overview 

1. Refer students to "The DECIDES Model"page in workbooks 

2. Go over 7 separate steps that form an* acronym — explain 
acronym as a way to remember something 

B. Explain steps briefly 

1. Refer to "The DECIDES Method j Definitions and Examples 
page in workbooks 

C. Ask for questions, comments 

D. Refer to book example, "The DECIDES Kodel: An Illustration" 
page in workbooks. 

Note J Run through this example if you like. 



150 



LESSON PIANt Session #1 (cont) 



VI. Discussion Period (if time) 

A. Ask students to name decisions they must make on a 
daily basis (list on board) 

B. Ask students to name life's most important decisions 
(list on board) 

C. Ask students to name some important decisions they must 
make within the next year (list on board) 

How do you know if you've made a good decision? 
(list characteristics on board) 

VII. Review of work to be done (by next V/ednesday, Iferch 7th) 

A, Reading 

B. "Decision Log" 
"Decisions That I Iviake" 

"Describing Decision" — very important? think over carefully 



Note: If you have time left over or the Discussion Period does' 
not seem to go, just ask them to get started on their assignment 
and circulate around the group to ansv^er questions and offer 
encouragement. 
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LESSON PLAN 



Session #2 7, j^^^ 

0BJECTIV5S I 

The major goals of this second lesson are to: (1) review 
last week's work, (2) see that each student has at least one 
appropriate major decision to work on, (3) provide guided practice 
with the DECIDES model by involving the group in the "checking 
account" decision, (i;) give the students practice in formulating 
problem definitions, and (5) review work to be done for next week. 

tSTHODS t 

I. Review of past week's work 

A. Ask students to share "Dec. Log" and "Dec. I Make" entries 

B. List the "bigger" decisions on board 

C. Ask if everyone has picked a major decision to work on 

1. If noti (a) suggest that they consider the kinds 

of decisions others have mentioned, and (b) involve 
the group in brainstorming another 10 or so options 

2. Note I You may want to generate you own list now 
in case it is necessary to "prime the pump" 

3. Emphasize importance of selecting and describing 
a decision situation by the end of today's class 

II. Model use of DECIDES method with bank example 

A. Describe decision problem— opening a checking account 

B. Refer S's to appropriate workbook forms: action plan. 
3 bank brochures, and values/alternatives grid 

1. Make sure they make appropriate entries on their 

action plans and grid forms as you model the process 

C. Complete guided practice— solicit S's help w/ each step 
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Session #2 (cont) 

III. Review "Define the Problem" (briefly) 
A. What does it mean? (Ask S's) 

3. \Vhat happens if you don't define a decision problem? (Ask S's) 

1. Delaying until too late (Ask S's for example) 

2. Allov/ing others to decide (Ask S's for example) 

C. Emphasize t (l) variety of ways to define any decision problem, 
and (2) problsm statements are not either clear or unclear, 
but can be made less vague 
1. Example! "I want to decide how to become a success." 
(Ask class to improve) 

IV. S^all group activity— "Alice's Problem" 
A.. Divide class into 2 groups 

3. Ask them to read and discuss "Alice's Problem", and then 
write on or more problem definitions of the decision 
facing Alice 

C. After 10 min., reconvene and discuss with entire class 

V. Assign work for next week 

A. Read "Jim's Summer Job": Define the Problem— 1 page 
3. Review the checking account exercise. Kow might you 
have done this differently? 

C. Do "let's Get Specific" exercise 

D. Do "Defining Ky Decision Problem" exercise 

E. As you define your decision problem, start thinking about 
what needs to be done to make it. because next week we'll 
spend most of our class period working on :£our Action Plan 

Mote: Suggest you visit school's Career Planning Center located 

in the Library (turn left after entering Library). This 

facility is operated under the direction of i.is. Jan r.^r mo. 
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LESSON PLAN 



Session #3 :.!arch 1^, 1979 

I. Review of past week's work 

A. "Let's Get Specific" exercise 

1. Ask for comments or questions --perhaps ask several , 
students to volxmteer their revised versions of one 
or more of the statements 

2. Ask S's to write their names on top of page & hand-in 
, B. "Defining My Decision Problem" 

1. Everyone do it? Any problems? 

2. Note t Meet with any kids who either didn't do it or 
had difficulty while others work on their action plans 
later in the session 

C. Bank Example (applies T:»rimarily to Dan's class) 

1. Which bank did jou pick for me and why? 

2. How did you arrive at this choice? 

II. Discussion of action plans 

A. What is an action plan? 

1. -Purpose? How to build? 

2. What does one look like? Refer to: 

a. Jim's (SumoTier Job story) 

b. Paul's ("A Sample Action Plan") 

B. When is an action plan helpful? 

1. Kinds of decis5ons where you wouldn't bother witn one? 

2. Decisions where planning actions is useful? 
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III. V/orking on individual action plans (main focus of this session) 
A. Refer class to Action Plan for l'f:y "Big" Decision forms in 
their workbooks 

1 . Have them copy their problem definition in the 
appropriate space here 

2. Suggest that it may be helpful to refer to the sample 
action plans (Jim's & Paul's) as they work on their 
O'/m today 

3. Divide class into pairs 

1. Have S*s explain to each other the nature of their 
big decision problems 

2. Ask them to start working on their action plans, and to 
ask each other for help and suggestions as needed 

3. Circulate around group, spending about 5 minutes with 
each pair of students, making sure all have defined 
their problem adequately and understand the purpose 
and nature of an action plan 

lY. Assign work for next week 
A. Read and review 1 

1 • Jim's Summer Job" — Establish an Action Plan and 

Clarify Values sections 
2* "A Sample Action Plan" 
3. "Some Work Values and iVhat They Kean" 
3. Complete action plan begun in class today 
V. Optional activities, exercises 

A. Some individuals in your class may be actually working 

through a decision right no\Y. Ask them to fill out a simple 
action plan and values/alternatives grid (forms provided) 
and report their experience to the group next week. 

3. Take class to the Career Planning Center 
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LESSON FI/i?l 



Session -viarch 21, 1979 

Objectives : V/e want students to: (l) understand the concept of 
values and how they affect our lives; (2) begin clarifying their 
ovm values and to recognize several strategies for doing this; 
(3) see the influence of values on the decision-making process; 
and {^) participate in a forced choice, structured exercise in 
which they must not only make some decisions as a member of a 
group, but communicate and even defend their preferences to 
other group members. 

materials ; Student Workbooks--materials for Week ^ 

Guidelines for "Fall-out Shelter" exercise 
"Personal Work Values" exercise sheets 

S teT3S I 

I. Review of past week's work 

A. Action olans^ -^should be completed by nov/ (check with S's 
absent last week to make sure they understand assignment) 
Que s t i ons ? Problems ? C omments ? 

Bi Assigned reading 

1. "Jim's Summer Job": V/hat were his v/ork" values and 
how did he become aware of them 

2. "Work Values" listed and defined in our V/orkbook 
(early entry — ^variety) 

a. What dot say, early entry, prestige mean? 

b. Are there other work values important to you 
that are not on this list? 

II. How does one clarify values? 

A. What activities did you list on your action plans? 

1. Instructors might begin this by sharing some of. 

their ovm listings. 
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Session ^ (continued) 

2. Ask S's to share their plans and encourage others 
to help by suggesting additional activities 

B. Values clarification exercises (in class) 

1. "Fall-out Shelter" 

a. Divide into 2 groups (if 5 or more S's present); 
Each group v/orks independently for 15-20 min, 

b. Groups convene to share decisions, reactions 
and perhaps discuss/argue differences 

2. "Personal Work Values" exercise— allov/ up to 5 rain* 
III. Assign work for next week 

A. "People I Admire" exercise 

1. Emphasize importance of talking to one of these 
people 

2. Model use of some open-ended questions to use in 
the interview: e.g. How did you become aware of 
v/hat you wanted to, gain from your life's v/ork? 
What do you most like about what you're presently 
doing? Least like? Kow has what's important to 
you in your work changed over the years? 

3. "Your Epitaph" exercise 

C. "My Values" exercise for their major decisions 

D. Announce that next week you'll meet in your regular 
classroom, take roll, and then move on for an 
orientation to the Career Planning Center. 




157 



173 



LESSON PIAn 



Session #5 f/^rch 23, 1979 

Today's class wxll consist mainly of an orientat5on to 
the Career Planning Center conducted by Jan E^artino. In 
addition to providing an overview of the materials available 
there, Jan will demonstrate the use of the Guidance Information 
System (GIS) terminal, and give each student a brief assignment 
on the GIS to complete during the next week. 

I. Before the tour— in your classroom 

A. Take roll 

5. Review last week's assignments: questions? problems? 

1. "People I Admire" 

2. "Your Epitaph" 

3. "I^ Values" 

C. Dismiss to Career Planning Center 

II. Tell Jan you need the last 5 minutes of the period 
A. Assign 

1. "Identifying Alternatives for Jim's Summer Job" 
(Should be completed working with at least one 

other" member of the class) 

2. "r.'^y Alternatives" (for major decision problem) 
3. Remind S's to meet in regular classroom next V/ednesday 



17.1 
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LESSON PLAN 



Session #6 April 1979 

This is our next tc last session, and our final full 
instructional period. Much of our last session will be spent 
administering the CLDVA and a class evaluation form and signing 
kids up for appointments to take the CDS. 

What's -She best use of our remaining *: -so minutes? 
Rather than present you with a structured agenda, I've proposed 
the following list of possible activities. Let's discuss these 
items, and see if we can agree on our priorities and a 
reasonable sequence. 

1 . Review of Career Planning Center orientation t 
— ^rfhat did you learn there? 

— Some kids will have completed an occupational search on the 
GIS. Ask them to share their findings. 

— Vn^at stage (s) does use of the CFC library represent in decision 
making? 

— Vfhat other ways are there to identify alternatives? '/Vhat other 
activities did you list on your action plans? 

2. Using a grid system : 

— V/hat can we do once we know our values and our alternatives for 
a decision? ^make a grid) 

— What can we do v^ith information we gather relating to those 
values and options? (fill in the cells of the grid) 
— Note: need to illustrate with concrete example such as Jim's 
summer job quest or one of your own choosing. 
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3* Jim's Summer Job Bxample g 

— He*s already listed his values for you in your v/orkbook. 
Last week you were asked to identify some alternative jobs for 
him. Using the grid form provided » fill in the spaces for 
Jim's values and the alternatives you listed for him (ask S's 
who didn't already list alternatives to get together for 5 min. 
and brainstorm a list). 

—Mow make a question out of each of Jim's values that he might ask 
about potential jobs. Ansv/er each of these questions for all of 
the alternative jobs you list'ed for Jim. You may work in pairs 
or small groups to do this. 

— 3y ansv/ering a set of values questions for each of Jin's 
alternatives you have been discovering probable outcomes 
(reference step of model on wall chart). 

— Next try to find the best option for him. How will you do 
this? One method is explained on the page labeled ^'Eliminate 
Alternatives for Jim" You may prefer another method. 

^- Discovering Probable Outcomes for your "Big" Decision : 

— Using a grid to list values and alternatives 

--How will you estimate or find out what each alternative would 

be like? Is your action plan helpful here, or should it be 

modified? 

— Complete the grid and make at least a tentative choice. 
Complete last page of workbook and come prepared to discuss your 
decision next week. 
5- Occupational Sx-oerience Exercise 

--During the period, choose l of 20 part-time, v;ork experience 

program jobs. Leave' it unstructured—look for application of 

some systematic DM procedure, especially the use of a grid. 
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LESSON PLAN 



Class Session (.f7) April l8. 1979 

Today's class will be a wrap-up session. In addition to 
summing up and getting closure on the model of career decision 
making we've been teaching, there are several very important 
administrative details which must be completed. I think our 
experience indicates that administrative details should be 
taken care of first, and the more open-ended activities used as 
time permits. 

Suggested sequencings 

1. Administer the Check List of Decision-Making Ability 

2. Explain the nature, vital importance of the Career Decision 
Simulation. Emphasize t (a) it's fun to use, (b) can be 

an enjoyable learning experience, and (c) they each will earn 
$5 by keeping their appointment and spending about 2 hrs. of 
their tim"fe. 

— Remind them that they'll be excused from any classes they 

miss while using the CDS 
— I^ake sure each student fills out a "Sign-up Form" 



3. Allow each student to discuss hisAer "Big" Decision 

k. Occupi^tional Experiences Exercise (the 20 part-time jobs) 

5, Class Evaluation Forms 




6. Ask Ss to hand-in their DECIDES workbooks. Have them write 
their names on the first yellow divider page, and if they 
want to have them back, write "please return" below their 
names . 
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APPENDIX E 

•THE CHECK LIST OF DECISION-MAKING ABILITY (CLDMA) 



Name ■ ■ . _ • 

(please print) ^ 

CHECK LIST OF DECISION-MAKING ABILITY 

You must make, decisions every day about what to wear to school, 
what to eat for lunch, and how to spend free time. But at times you 
must also make important decisions with more serious consequences, 
like how you'll spend the summer, what you'll do after graduating, 
and what kind of career you are interested in. 

We want to know how good you think you are at accomplishing 
varices actions that may be a part of making important decisions. 
On the following eight items, how would you rate your ability as 
cotr.;;?ared with the average person your age? 

Poor Average Excellent 

I i 1 — — I \ i 1 1 r 

12 3 4 5 6 7 8 9 

Write the number representing your ability opposite each question. 

1. TO RECOGNIZE WHICH OF YOUR DECISIONS ARE MORE IMPORTANT AND WHICH 
ARE LESS IMPORTANT? 

For example : Hov7 good are you at figuring out which decision has 
the most important consequences for you: what to have for an 
afternoon snack, what to do Friday night, what classes to take 
next semester, or which colleges to apply to? 

2. TO BUDGET TIME FOR MAKING DECISIONS? 

[ For example : In Example 1, how good are you at planning the 
j amount of time needed to make each of these decisions? 

3. TO SAY WHAT YOUR VALUES ARE? 

For example : Before choosing a new class, how clear are you 
whether you are taking it for enjoyment, fulfilling requirements 
or being with your friends? 

4. TO COME UP WITH ALTERNATIVES FOR A DECISION? 

E For example : How good are you at coming up with^in teres ting things 
to do on a weekend? 

5. TO UNDERSTAND THE POSSIBLE OUTCOMES OF VARIOUS ALTERS] AT IVES? 

For example ; If your weekend choices are going camping, visiting a 
friend in Sacramento, or studying, how well can you state the 
possible results of each of these choices in advance? For instance 
camping may satisfy your love of adventure. Studying will help you 
get better grades/ 
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^TO WEIGH ALTERNATIVES AND ELIMINATE THE LESS DESIRABLE ONES? 
For_exam£le: Given the choices in Evamplc 5, hoK oood arc 
for each activity and choosing Z tlst one 

JO CARRY OUT A PLAN OF ACTION FOR MAKING YqUR DECISIONS? 
For example ,; If you have decided to go camping on the weekend 
how well can you outline and carry out the Ltep^s necesslrj to 
accomplxsh your plan? For instance, can you find a suitable 
campground, collect the necessary equipment, and organize 
transportation, as well as set deadlines for each of these 

S C 6 p S • 

sLf A^CeJJIblE?''^""'"'' "^^^ """^ ™^ ''^^^^^^ ALTERNATIVES 

For example ; You have discovered that a class you planned to 
take has been cancelled. How good are you at rethinking what 
you wanted from the class and finding some new possibilities' 
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APPENDIX F 

DIRECTIONS FOR THE CAREER DECISION SIMULATION (CDS)* 

Hello. We are pleased that you are willing to participate in this 
research project. We are trying to learn more about the ways that people 
make career decisions. Since career decision making is difficult to study 
in real life we have devised this simulation experience which represents 
some parts of what it is like to actually make a career decision. 

The card boxes and cassettes you see on the table in front of you are 
information sources which you will be" able to use in your career search. 
In a few minutes I will tell you how to use these materials. But first 
let me explain your task: Imagine that you are in the process of making a 
decision about which career to pursue. The career you choose may well be 
your life's work~so it is an important step. You have a number of 
possible careers open to you but so far you know nothing about any of 
them. Information about each of the careers is available, and you may 
choose to investigate as much or as little of it as you want. The 
way in which you go about making your decision is entirely up to you. 

Now let me explain a few basic procedures. Firstj notice the tape 
recorder in front of you. If you should want to stop the tape for a 
moment or two in order to follow some instructions you may push the 
stop button. If you have not used a tape recorder before, please ask the 
administrator to assist you. (pause) I will signal when you should 
stop the tape by sounding this bell — clang . When you hear that sound, 
stop the tape, and follow the instructions you have just heard. Then 
when you are ready to listen again, push the play button. All right, 
now I would like you to notice the card in front of you labeled Name Card. 

*Transcript of the audio tape which orients users of the CDS to its pur- 
pose, components, rules, and use. 



165 



On that card I would like you to fill out the information asked for: 
aame, today's date, your sex, and what time it is now. Clang . 
Thank you. On the back of the Name Card you will find a black dot. 
Please put your thumb on that black dot and insert the Name Card into 
the slot in the Card Return Box, (pause) The Card Return Box is 
where you will place every card you choose after you have read it. 
Once you place a card in the Card Return Box you are not permitted to 
draw it back out or read it again. 

The jobs you will be investigating here differ in the values they 
provide. For example, a particular job may be high on the value of 
income, moderate on the value of security, and low on the value of 
variety. Since people differ a great deal in terms of what job values 
are most important to them, there is no one job which satisfies everyone. 
If you are unsure about the meaning of the job values feel free to look 
up any definitions whenever you wish. These definitions are contained 
in the card box to your left labeled Value Definitions, Remember to 
place each card you read into the Card Return Box before you take the 
next card. 

If we could make this experience completely true-to-life you would 
be making^ your career selection from thousands of jobs. Because this 
is simply not practical, there are only 12 jobs from which you will be 
choosing today. These jobs have fictitious names such as Breandist, 
Tasindic, and Geebist, They represent a variety of types of jobs that 
you may find in the real world but they are not modeled after any specific 
jobs that actually exist. How can you find out about the various jobs? 
Look around you at all the possible sources of information. You will 
see that you can obtain information from books or magazines, career 
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handbooks, career speakers, friends, horoscopes, newspaper ads, personal 
experiences, radio or T.V., or worker interviews. Remember I told you 
that all the jobs in this game have fictitious names. I'm going to pick 
one pretty much at random and show you how you can find out about each 
job. Just to get you started, let's look at the newspaper ads. In 
the newspaper ads box find the card for Breandist that tells about the 
income for Breandist. You will find headings across the top of the 
card that will say "Newspaper Ad - Breandist - Income". Find that card 
now and read it. Clang . Now make a judgment as to whether you think 
the income of Breandists is high, medium, or low based on that one bit 
of information from the newspaper ad. (Long pause) This information 
source indicates that the income of Breandists is low. Were you able 
to accurately interpret this one piece of information about Breandists? 
Each job has real objective values independent of what you think they 
might be. You will find that some of the information is not perfectly 
clear — maybe a bit ambiguous, or not totally consistent. This might 
lead you to make the wrong judgment about whether a given job is high, 
medium, or low on any particular value. Just as in real life the jobs 
here have cer^in set characteristics but the information you get 
about them may not always be completely clear and obvious. Now be sure 
you place the Breandist income card in the Card Return Box, as you 
must return every card there before you pick upyour.next card. Just hold 
the card with your thumb on the black dot and push it firmly so that it 
falls all the way down into the Card Return Box. 

Naturally you want to pick a job that gives you most of what you 
really want in a job. It appears from the information you have seen 
that the income of a Breandist is low. Does this mean that Breandist 
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is not a good job choice? It may or may not. Whether or not income 
affects your ultimate satisfaction with a career depends entirely 
on what you want from a job. Income may be one of your prime consider- 
ations in choosing a career, or it might be of moderate importance, or 
it might not matter to you at all. 

I*m almost ready to let you begin your search — remember, there 
is no such thing as a "right" or a "wrong" job choice within this 
simulation. Your goal is simply to find the job that satisfies you 
most. Approach this task as if it were your real career decision. 

You can take as much as an hour and- a half to make your decision 
but you don't have to use that entire time — you may make your decision 
immediately if you like. Feel free to pick cards from any information 
source but only one card at a time. Remember to place each card in 
the Card Return Box before you choose your next card. A pencil and 
notepad have been provided in case you want to make any notes. Choose 
as much or as little information as you want. You won't have time to 
use it all. When you make your decision and writa the name of your 
chosen job down on the Job Decision Card the simulation will be over. 

When this tape ends, rewind the tape by pushing the rewind 
button. Whenever you play other tapes always rewind each one and return 
it to the place where you found it. Now rewind this tape and enjoy 
your career search! 
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Introduction 



You are about to perform a crucial task as part of a research project 
that -is designed to assess how well people make career -related decisions. 
Your job as Administrator for the Career Decision Simulation (CDS) exercise 
requires careful preparation and attention to details, since the CDS is our 
primary measure of career decision-making effectiveness. 

Each subject's score on the CDS will be compared to the scores of a 
large number of other subjects. Thus, it is essential that each administra- 
tion be done as uniformly as possible. This means setting up the materials 
in the same arrangement each time, making sure none of the simulation rules 
are violated, answering any questions consistently and only as specified 
in this Manual, and keeping track of the 90-minute time limit. 

Your job will be a busy one. You must be sure that each subject follows 
all of the simulation rules. Since you may be responsibile for admini- 
stering the CDS to two subjects at any given time, your familiarity 
with the CDS rules and set-up is essential. 

Remember, we are interested in discovering the procedures used by 
people to make career decisions. One of the most Important means we have 
for uncovering these- procedures is to record the; order in which people 
use pieces of information. Therefore, it is very Important to keep all 
of the ci^rds used by each subject in the exact sequence in which they were* 
placed into the Card Return Box* 

Finally, it is suggested that each Administrator spend at least 
90 minutes playing the CDS before administering it to any subjects. This 
gives one a 30od appreciation of how it feels and looks from the subject's 
point of view and is really the best way to learn what the CDS is all about. 
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Checklist of Administrator's Duties 



- Before Subject (s) Enters - 



1) 



Check physical set-up: e.g., screen between S's (If available). 



chair for each S and Administrator, two 3' x 6' tables (with S's 
back-to-back) small table for cassette holders, etc. 

2) Check simulation materials against the Inventory listed on pages 5 
and 6. * 

3) Set lip materials according to diagram. 

4) Check cassette player for proper functioning and volume level; also 
check headsets. 

5) Put new card deck(s) Into boxes. 

6) Check to make sure there Is sufficient light. 

- With Subject - 

1) Go over Introduction Guidelines 

2) Be sure S places "Name Card" In Card Return box properly. 

3) Be prepared to show S how to use cassette player. 

4) Make sure S follows^ all games rules. ' 

5) Watch the clock to make sure 90 minute time limit observed (time 
from end of Instruction tape to completion of the "Job Decision" 
card); Inform S when only 15 minutes are left. 

6) Make sure S fills out the "Job Decision" card. 

7) Once S has filled out a Job Decision card, present S with Job Rating 
Form and appropriate Instructions, 

8) Remove Job Rating Form and present S with Personal Work Values Rating 




Form and appropriate instructions. 



- After S has completed the Job and Personal Work Value Rating Forms - 

1) Thank Subject. 

2) Explain that the exercise is over. 

3) Answer S's questions. 

4) Pay S and have S sign receipt list. 

5) Fill out Job Choice Form - Very important to be accurate here. 

5) Pull deck of cards from Card Return Box. Put rubber band around 
entire deck placing S's Name Card on top; make sure exact sequence 
of cards is retained, especially when placing the Name Card on top 
of the deck. 

7) Retain S's notes and label them with S's name and today's date. Attach 
to "Job Choice" Form. 

- Setting Up For Next S - 

1) Pull unused cards from all boxes, rubber band, and label with S's 
name and today's date. 

2) Return pegs to boxes and replace Personal Work Values and Job 
Rating Forms. (These objects should be removed from view of next 
sub ject) • 

3) Recycle through the Checklist of Administrator's Duties in 
preparation for the next S to use that table and CBS. 
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Xnvfenton/ _o f Cnrocr n t' cifvlon S imti l nri£n_fnnt; ) Ma tor i.a I. s 



-3 Personal V/ork' Values Rat in« Form 
-1 Job Rating Form 
-111 Blue High ("H") Pegs 
-111 Red Medium ("M") Pegs 
-111 Yellow Low ("L") Pegs 

-3 Plastic Peg Boxes (1 blue, 1 yellow, 1 red) 
-9 Job Information Card Boxes 

^ 



~ Book or Magazine 

- Career Handbook 

- Career Speaker 
~ A Friend 

- Horoscope 

- Newspaper Ad 

~ Personal. Experience 

- Radio or 

- Worker Interview 



Each containing: 

- 12 index tabs = 12 fictitious jobs 
arranged alphabetically (Breandist - 

Zampic) 

- 36 3x5 cards/box; 
3 cards/job 



1 
1 



Value De-finition Card Box (containing 9 cards) 
Card Return Box 

109 Cassettes: 1 labeled "Directions"; the others labeled Tape //I - Tape /MOB 
2 Cassette holders: 

-1 holds 72 cassettes (large): Tapes //I - //60 (ajnd "Diroctions" tape) 
-1 holds 48 cassettes (small): Tapes //6i - /,'108 
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Tnvontory of CDS Matoripls (Contd) 

-1 Cassette player 
-1 Set of headphones 
-1 "Start Here" card 
-1 "Name" card 
-1 "Job Decision" card 

Pencils for S and Administrator ^ 
- Notepad 

Some kind of timepiece 

Supply of rubber bands 

Index cards for Administrator to label stack of unused cards 
-1 Administrator's Manual (with Job Choice forms) 
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TABLE LAYOUT FOR 
CAREER DECISION SIMULATION 



131 




ERIC 



GfMicrnl. 1 nlrocluc L ion (ujidcl iiies 



HeUo, I'u. . . . 

Plo.asc bo seated. We're happy that you're able to help us out with 
this research.. 

First, let ttic tell you something about what we're trying to do. Our 
main purpose is to learn more about the \;ays that people make decisions 
about the jobs and careers they select. 

Since decisions are difficult to observe in real life, we're attempt- 
ing to use a simulation model to get some information. That is what all 
of these things on the table are for. 

We don't have any tricks up our sleeve, and there are no surprise 
endings. This is nc^L a test. We're merely interested in tl»e way in which 
you go about making your decisions and coming to your eventual conclusion. 
We'll 3tudy thr^t by locking at which cards you use and the order ir which 
you use them. 

I'll be the "administrator" for this exercise. My role is to make 
sure you follow several rules and to answer your questions. 

Very shortly you'll be hearing specific instructions on exactly 
what to do. To begin, I want you to read the "Start Here" card in front 
of yoi: on the table. 
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SinmlnLioii Rule;; 

1) S nmst rend -StnrL Here" card, fill out "Name" card, listen to 
and follow DlRECriOWS tape, and lill out final "Job Decision" card. 

2) S niust place onch card in the Card Return Box (by placing thumb on 
dot) prior to selecting or reading any other card. Thus, only one 
card may be rpaH ,nr,r, rimr 

3) S must read any card picked before placing it in the Card Return Box. 

4) Ss may survey or "flip through" the label sides, (front) of cards as 
much as they wish, as long as they do not read the information (back) 
sides of cards. 

5) S is not permitted to open the Card Return IJox. 

6) S may move card boxes for easier access if desired. 

7) S must rewind and return all tapes used to the Cassette Holder. 

8) S may wear earphones throughout the session. 

9) Ss must make their job decisions within 90 minutes after completing 
the "Directions" tape. 

10) Sg must rate their final jcb choice on each of its 9 value- 
characteristics after filling out the "Job Decision" card. There 

is no restriction on the number of H, M, or L pegs used to make this 
judgment on the Job Rating Form. - 

11) S must assign 3 H, 3 M, and 3 L Peg., on the Personal Work Values 
Rating Fom. after completing the value ratings on the Job Rating 
Form . (The Job Rating Form must be out of S's view at this time.) 
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Jjl^.S-J2'^*Li2IliLJl2 J>l'_iL^^^^^ .M>|) l^at^hu; Form 

After Ss have U.Ucd out the Job Dc.-oision c;.rd, pro.sont Ss witli tho 
Job Rating Form , ratins pc.««s, and say: 



You've done some research today on (S's Cina] 

job choice). Based on the information you've gathnred, how would you rate 
each of the characteristics or values of this job? These coJored pegs 
are marked either 11 for high, M for medium, or L for low. Please indicate 

whether rates high, medium, or low on each of the job values 

listed here. Don't worry if you are uncertain or if you doa't know 

exactly how would rate on a particular value. Simply .nakc the ' 

closest judgment you can based on the information you used here today. 
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ERIC 



Ins r rur tAjm^ t^_\2C^j[yn^^ 

After the? have, rated tha 9 chnractfjristics oT Chcir final job choice, niu 
Clu» Job Rating Form has been remove d from their view, present Ss with the 
Personal Work Values Rating Form and say: 

It's usually not possible to find a job which has exactly what you want. 
This is especially true when there are as few as 12 jobs to choose from. What 
we'd like you to consider now is your "ideal*' job. I-Jhat characteristics would 
a job that was tailor-made for you have? 

To help you think about this, I'll give you a rating form similar to the 
one you just used to rate the make-believe job you picked. Follow the instruc- 
tions at the top of the form. Remember, although we want you to make your 
ratings for an ideal job, there is the requirement that 3 of the work values 
be rated high, 3 medium, and 3 low. Once again, colored pegs marked "H" for 
hij^h, '*M" for medium, and "L" for low are provided to make your ratings. 
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Try to make a dlsUinction ber.woon proccdMvil qiw^scion.s and s.ibMtrm- 
tive questions which a.k for advice o,<. how to actually mak,.- docision.s in 
which we are interested. You may answer procedural ci„e.s.:ion.s such as : 

- Q: Can 1 move tlicse boxes around' 
A: Yes. 

- Q: What do 1 do now? (immediately after DIRECTIONS tape) 

Ir.'"'"^'I ^'^'''"^ "'^^^'"S °^ "^''^ rards/one at a t^me, 

m any order you v/ish. ' 

- Q: Can I pull any cards I want? 

Retur^i "f"^ P"^^ Pl^" t^hc Card 

Return Box before selecting another one. 

- Q: ^^mat's the note pad for? 

A: You may use this pad for recording information and making any notes 
that seem helpful. 

- Q: VOiat happens if I don't finish in time' 

A: If you haven't selected a job at the end of 90 minutes, you will be 
required to choose one at this time. 

Remember, such questions should be answered as explicitly and succinctly 
as possible. 

You may not answer substantive questions such as: 

1) How much time should I take on each card? (B) 

2) Which boxes should I use? (B) 

3) Wliat's a Career Handbook? (A) 
A) Should I take my time? (B) 

5) Should I rate this ;yalue for Splackcr high? (B) 

The administrator cannot directly answer these questions. Subjects 
should be given these two answers: (A) "You can find the answer to that 
question by using the materials in front of you." (B) "That's your 
decisien." 

Answer all "Is it better..." questions with response (15). 
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THS ,CAR22R D.'SCISIOM SIMUL;\TION 
APPOINTMENT FORM 

Your name (please print): 

Phone number (s) where v/e can reach you: 

V/hat v/ould be the best 2 hour time period for you to use 
the Career Decision' Simulation? Remember, you v/ill be excused 
for any class time you miss, but try to pick a xime v/hen you'll 
be missing no more than one class period. 

Indicate your 1st, 2nd, and 3rd choices by placing a 1, 2, or 
3 after three of the tine periods listed below; 

-3:00--l0:00 A.?.% 

IO13O A. K. — 12:30 P.M. 

1 x00— 3x00 P.M. . 

3:20--5:20 P.K. - 



You v/ill be assigned one of these periods and given a card 
telling you of the date, time period, and room number for your 
appointment. It is very important that you be there on^.time! 
Please indicate here if there are any days of the v/eek (P'onday 
through Friday) when you would not be able to keep your 
appointment for one of the 3 times you indicated above. 
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CDS APPOINTMENT REMINDER FORM 

• • V you have an 

appointmeni: to use the Career Decision Simulation 

°" at 

in , 

Please be prompt. If for some reason you are 
unable to keep this appointment, call Kr. Kamel at 
327-1989 as soon as possible. 
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JOB CHOICE FORi^! 

Subject 

Administrator 

Job Choice 



Job Values Personal V/ork Values 

Ratings Ratings 

(H,M, or L) (H,M, or L) 

Early Entry 

Helping Others ^ 

Income ^ 

Independence 

Iieadcrship ^ ^ 

Leisure ^ ^ 

Prestige , 

Security 

Variety . 



Date 

Ended 

Began 



Administrator's Comments i 
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JOB RATING FORM 

Based on the information 
you've used, how would you 
rate the occupation of 



, early; ENTRY . pn'-'^v 
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ERIC 



PSRSOMAL V/PRK VALUliS 

In choosing a career, hov/ important to you is each 
of these values? Rate 3 values hirch (11), 3 values 
p.odium (I!) I and 3 values lov/ (L). 

VALUES RATING 

Early entry 

Helping Others ♦ 

Income 

Independence ■ 

Leadership 

Leisure' 

Prestige 

.Security 

Variety 



203 

187 



STAUT IIKKK 

Yon arc .•il>oia to mnk«! :i m»i )oi' cari-iT ih r i s inn-- 
buL (Miiy n.s part ul' i tnii ! .it ion I'Ncrrisi'. Yoti will 
find I ho ]>roi*ess hotli I'^hicnC iona 1 aiul Itui. 

You nvc Co prt'Conil c'aat you waiU Co ilcriiU^ on 
your lil'e's work, or ac ii.asi Chr joU you want Lo 
try nr/.t. Try to npproncl^ thin cask in tlu* way ytm 
woultl rccilly dec it! c on a cnr'. or. 

This simulation cxi-rcisc is sol f-uxplanatory. 
Your next stop is to find the ensiioLte capo lahc:U«d 
*MMre( t ions" ahove Tapo 1 in the CasseLl u Tapu 
Holder. InsiTL tlii.s tape in die tape i»layer , ptisli 
tlic "Play*' button and follow tlio directions you 
will hear. 



NAME CARD 

(Please Print) 

LAST NA^lEnOQOQOQQQQQ 

FIRST N.^ME|— inizDoncDnizjo 

TODAY'S DATE (Z!! □ 197 □ 

"(Month) (Day) (Year) 



YOUR SEX (M or F) { j 

ENTER EXACT TIME NOW : |^ [^j 



A.M. [- 1 
P.M.CZ] 



Job Decision Card 

Job Name 

Enter exact time now 

P.M. □ 

How confident are you that you made the best 

possible job choice? (Circle a number) 

0123456789 10 

not moderately very 

confident confident confident 
at all 



Explanaclon of CDS Scores 



Accuracy Score 



The "accuracy" score is simply a measure of how accurately the 



subject races each of the nine work values for the chosen occupation. 
Presumably, these ratings reflect: (1) the amount and kind of information 
accessed; (2) one's ability to interpret the information's Intended 
meaning correctly; and (3) one's ability . to recall those interpreted 
meanings while rating the chosen occupation as being high, medium or 
low on each of the nine work values. 

Given the task of rating nine work values as either high (3), medium 
(2), or low(l), 15 is the maximum number of "increments" one could err 
by in rating an occupation since all 12 occupations were randomly assigned 
three high, three medium, and three low values. In order to create 
transformed scores with a midpoint near 50, the following CDS "accuracy" 
score key was used: 



CDS "Accuracy" Score Key 



Total Number of 
Increments off 



Equivalent (transforaed) 
Raw Score 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 



85 
80 
75 
70 
55 
60 
55 
50 
45 
40 
35 
30 
25 
20 
15 
10 



Range = 10-85 



Theoretical Mean = 47.5 



Obtained Mean 



= 61 
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Values Congruence Scores 

The values congruence scores are based on the "degree of fit" 
between the assigned work value levels of the chosen occupation and 
forced choice work value ratings reported at two different times. The 
rationale for this criterion is that good decision makers choose 
alternatives consistent with their expressed value preferences. A 
"Time 1" paper and pencil values rating rask (see page 17 of this 
manual) is administered about one month before subjects use the CDS. 
The "Time 2" rating task (see page 16 of this manual) is administered 
immediately after a subject chooses a CDS occupation, and is identical 
in nature except for the use of a wooden form and pegs instead of paper 
and a pencil. Thus, two different values congruence scores can be 
generated for each subject, allowing inferences about the stability 
of values preferences and the influence of a recent choice on value 
preferences. 

Raw values congruence scores are computed according to the following 
scoring system which awards points based on the closeness of match, 
with high value matches being worth more than mediums, and mediums 
correspondingly more than lows. 

Each of the nine ratings on the. Personal Work Values Rating Form is 

compared with the "real" level (high, medium, or low) of the job 

chosen, by the subject. 

Number of Points Each of Your Values Will Earn 

If your personal TThen the real level of your Career Decision ' 

work value is on that value is 

High • (H) Medium , (M) Low(L) 

High (H) 60 20 0 . 

Medium (M) 30 40 5 

Low (L) 10 15 20 
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Here, for example, is how a given person's score would be 
determined. 



Suppose 
Ms, X had 
made chese 
ratirigs 



Suppose Ms X had 

chosen che job 

of "Lawender" which 



She would 

Chen 

receive 

these 

points 



Values 



had these real 
levels on each 
value 



Early Entry 
Helping Others 
Income 

Independence 

Leadership 

Leisure 

Prestige 

Security 

Varie ty 



H 
M 
L 
H 
L 
M 
M 
L 
H 



H 
L 
H 
M 
M 
M 
H 
L 
L 



60 
5 

10 
20 
15 
40 
30 
20 
0 



Total 



200 



A computer-assisted calculation of the CDS scoring key for values 
congruence scores resulted in a computer printout on 95 8^" x 11" 
pages (see example on following page) • This key provides a handy 
way for the administrator to quickly determine a subject's values congru- 
ence scores on the CDS. It is systematically arranged to display 
the 1,680 different ways a subject can assign three high, three medium, 
and three low values from a set of nine different work values. For each 
of these 1,680 possible value level configurations, a raw score based, 
on the CDS's scoring system is provided for all 12 of the fictitious 
occupations from which subjects must choose. Thus, a subject's scores 
can be looked up in the printout simply by, knowing the ratings on the 
Personal Work Values Rating Forms and the name of the occupation written 
on the Job Decision card (see page 18 of this manual). 

Notice that the printout also provides standard scores for each 
raw score calculated. These standard scores were not used because an 
error was made in their computation. Also, it was concluded that a 
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112/223/31 


3 










2^5 


70 




235 


65 


r^- !5T 


230 


63 




250 


63 




215 


56 




20-; 


r>2 


f.PALICIAM 


2 ?r 












lof. 


3m 
















15iJ 


30 



112/223/331 




LLr!/;t:*n/MML 




ZAMPIC 


285 


70 




235 


57 




255 


57 


TASI?.'?!C 


25S 


57 




1^2 


m5 


c«;:c:;.w 


1^7 






l-'^!- 


MM 

































112/231/233 








TASINDIC 


285 


70 




2m 5 


60 




2^0 


5«J 


SPLACKEP 


205 


51 


OEPriCIAN 


2C0 


50 


M-lSTrP 


200 


50 


cv:»::ic 


200 


50 


JVtPlC 


200 


f.O 


L"^EA»:?I5T 


195 


m3 


-•EP23T 


160 


AO 




155 


39 


'•.VALICIAM 


115 


30 



llR/231/323 




iit\/rMi/\v.\]\ 




HI5TER 


250 


70 


DPEA?.JI5T 


2m 5 


60 


OrilCIAN 


2m 0 


67 


TASIK'DIC 


2?5 


65 


PLlf.'?ER 


210 


50 


DHPTICIAN 


200 


55 


Q'JLUMC 


rco 


55 


GEEBTST 


I'.'O 


52 


5PLACKER 


i->o 


5.: 




165 


<IM 


JHPI5T 




m3 


KIJALICIAM 


115 


30 



112/231/332 








TA51NDIC 


270 


70 


OL'fzMT iC 


250 


6m 




2m5 


63 


C>:JICIA?I ■ 


225 


57 


GEE0I5T 


205 


52 


5PLACKER 


205 


52 


HISTCR 


200 


50 


ZAMPIC 


200 


50 


r':'EAtiDl5T 


195 


A9 


DF''7ICIAH 


150 


36 


^»>'ALICIAN 


130 


31 




125 


30 



112/232/3 33 
LLM/M!H1/U'M 



PLIMOER 


2fl5 


70 


TA5IN0IC 


2'. 5 


60 


c.\r:Pic 


235 


57 


M.15TER 


205 


50 


GUEMTXC 


205 


50 




200 


A9 


0•UCIA^i 


200 


A9 


OEPTICTAM 


\'^S 


^8 


JEPI5r 


l^S 


A3 


SPLACKER 


165 


AO 


KRALICIAU 


150 


37 


GEr,DX5T 


120 


30 



!!2/232/3l3 








MI5TEP 


250 


70 




Cm 5 


63 




215 


56 




205 


52 


CMCZ/'I 


20? 


50 


TA5!*;?:c 


2CC 


5? 




1^5 


m3 


JCPI5T 


1^35 


AOi 


GrFUTGr 


103 


A6 


5:aAC*.ER 


19C 


Ai 


tAf'^^IC 


165 


36 


SOALICIAM 


150 


33 



112/232/331 










PLIKOER 


28^ 


7? 


TAr»IK?lC 




«... 


QVfiN'TIC 






;:Af:FIC 


2 7'"' 




CIJICIAS? 


2.' • 




MISTER 






EVEA*:DI5T 






GEEDI5T 


1 ^ " • 




SPLACKEP 






OEPTlCiAN 






JEPISr 


125 




K^ALICIAW 


125 


3* 



112/233/123 
'.l.'Vf!-'>:/Uf!ll 



D!;PTIC1AN 


2A5 


70 




235 


66 


7.:."t:.c 


235 


66 


jr:^:5T 


230 


65 


O'.'ICIAM 


215 


60 


"A5!»;d:c 


210 


53 


f'rrTE'j 


205 


57 


r"3;.».'::i5T 


200 


55 




ICS 


50 




165 


AA 


c'Jsr:Tic 


155 


Al 


GEEDIST 


120 


30 



112/233/132 




LLM/MMM/LM.M 




PLIK'DER 


270 


70 


ZAHPIC 


270 


70 


TA5IUQIC 


2m 5 


62 


GUENTIC 


2C5 


50 


KPALICIAN 


200 


A9 


OKICIAM 


200 


A9 


DEPTICIAH 


1<35 


A7 


JEPI5T 


195 


A7 


5PLACKER 


180 


A3 


HI5TER 


155 


35 


BREAIinrST 


150 


3m 


GEEB15T 


135 


30 



112/233/213 




t-Lv/nNM/riLH 




DEPTICIAM 


2A5 


70 


JEr>!ST 


230 


63 




215 


56 


T/5I;OIC 


215 


56 


S'-.'.ACKE^ 


205 


52 


!II5rER , 


200 


50 


Pt-IfOCP 


200 


50 




200 


50 


L'P^.^'::)r5T 


195 


A7 


K^ALICIAM 


165 


A3 


Gr>ni5T 


155 


30 


cv!:mtic 


155 


30 



112/233/231 
LLM/r«M!/r.HL 



TA5!^:DIC 


285 


70 


PLIM-JER 


270 


66 


ZAMPIC 


270 


66 


CMICIAH 


2 AO 


53 


DEPTICIAM 


200 


A8 


CL'EMTIC 


200 


AO 


5°LACKER 


180 


A2 


JEPI5T 


160 


37 


KRAIICIAM 


160 


37 


HISTF.rJ 


155 


36 


BPEAMUrST 


150 


35 


GEEDI5T 


130 


30 



112/233/31 






LUVr*» V/HLM 




Gr.EOIST 


205 


70 


'".'JENTIC 


225 


70 


S^L.-X^ '.R 


2C''« 


70 


!t!5T:P 


200 


50 


SP.MICIAH 


200 


50 


o*iici;*i 


■20C 


50 


f^L 


200 


50 


TAGltOlC 


2C0 


50 




200 


50 


•■•3A'."?T5j 


1".5 


30 


upncjAfj 


105 


30 


.'EPI5T 


195 


30 



112/233/321 




llm/mhm/k:!*. 






OMICIANf 


2A0 


70 




235 


67 


TASXrCiC 


2':. 


67 


z;.?:pic 


2:* 


67 


HI5TE:? 


2 or. 


52 


E'^EA»-::i5T 




50 


DEPTICTAJ; 


pro 


*0 


lVJE^^"^lc 


200 


\ ^ 


GEE-:rr.T 


:r..5 




5P1.ACK!:R 


1..5 




JEPI5T 


IvC 




KRALICIAJI 







112/312/233 
LLM/HLM/MHH 

I^REA^'OIST 270 70 

CEPTICIAM 270 70 

TASIK'OIC 250 6A 

H15TEV 225 57 

Q'JEUTIC 225 57 

ONICIAN 205 52 

PLIN:?ER 200 50 

ZAMPIC 195 A9 

JEPI5T 170 A2 

5PLACKER 135 32 

GEEDISr 130 31 

KPALICIAH 125 30 

2^5 



112/332/323 




LUJ/HLri/l? 


;){ 




BREAK'DIST 


320 


70 


>!l5r«:R 


27r*. 


61 




270 


'sO 


c'jE*:ric 


225 


51 


C'.'ICIAM 


205 


A 7 


ta5!»::mc 


200 


A6 


jep:5t 


170 


AO 


GcE^..T5T 


165 


39 


PL!N?LR 


165 


39 


ZA'TIC . 


160 


33 


MPALICIAJI 


125 


31 


5PLACKER 


120 


30 



112/312/332 




LUI/MI.M/HHM 




Q'JEMTIC 


275 


70 


tPEAMPlST 


270 


68 


TASIK'OIC 


235 


53 


MI57F.P 


225 


55 


DEPTlCIAtJ 


220 


5A 


PLIMDEP 


200 


A8 


ZAMPIC 


195 


A 7 


CNICIAN 


190 


A5 


GEEnisr 


180 


A2 


KPALICIAN 


lAO 


31 


JEPIST , 


135 


30 


5PLACKER 


135 


30' 



112/313/223 
LLM/HLM/ruiH 



DEPTICIAM 


320 


70 


DREAK'DIST 


2 70 


59 


HI5TCR 


225 


50 


CMICIAM 


220 


A3 


TAGTMOIC 


215 


A7 


JEPI5T 


205 


A5 


ZAMP3C 


195 


A3 


GUEMTIC 


175 


39 


KRALICIA?^ 


160 


36 


PLIMUER 


150 


3A 


SPLACKER 


135 


31 


GEEDI5T 


130 


30 



ERIC 



rank-order "goodness of choice" would better reflect the conceptualization 
of the values congruence scores. Therefore, raw scores are- simply trans- 
formed to create rank-order scores • These "rank order of goodness" scores 
reflect how close subjects come to choosing the occupation most 
similar to their value preferences ( a rank of 12 = best possible choice and 
a rank of 1 = worst possible choice among the 12 available alternatives). 

Thoroughness Score 

The "thoroughness of information search on highest values" score 
is based on the assumption that one should spend the greatest amount of 
time and effort gathering information about those aspects (work values) 
of a job setting one rates as being most important, A forced values 
rating task administered innnediately after subjects choose an occupation 
requires them to rate three values as being most important to them (see 
page 16 of this manual). The thoroughness score reflects what percentage 
of all information units used during a CDS performance relates to those 
three most important values. 

Confidence Score 

The confidence score is based on subjects' judgments as to how likely 
their chosen occupation represents the best one for them among the 12 
available. They rate their confidence on a 1-10 scale (10 « very confident) 
immediately after choosing an occupation (see the Job Decision Card on page 
18 of this manual). 
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APPENDIX H 



CHECK LIST OF DECISION-MAKING ABILITY (CLDMA) 
PRE-- AND POSTTREATMENT FACTOR LEVEL MEANS 
FOR ITEMS 1-8 



Table H-1 

Means and Standard Deviations for Pretreatment 
CLDMA Item 1 (Define the Problem) Score 



Class/Instructor 




Males 


Females 




Totals 


Group 




















N 


.M 


SD 


M 


SD 


M 


SD 


^ Experimental 


8 


5.50 


1.73 


7.25 


0 


.96 


6.38 


1.60 


Control 


8 


6.00 


1.63 


8.00 


0 


.0 


7.00 


1.51 


2 Experimental 


8 


6.00 


1.83 


7.00 


1 


.63 


6.50 


1.69 


Coptrol 


8 


6.25 


1.50 


4.50 


1 


.73 


5.38 


1.77 


2 Experimental 


5 


8.00 


0.0 


7.33 


0 


.58 


7.60 


0.55 


Control 


8 


6.80 


1.30 


6.67 


1 


.15 


6.75 


1.17 


^ Experimental 


8 


7.00 


0.82 


7.50 


0 


.58 


7.25 


0.71 


Control 


8 


6.25 


0.96, 


7.25 


1 


.71 


6.75 


1.39 


_ , Experimental 
Totals 


29 


6.43 


1.55 


7.27 


0 


.96 


6.86 


1.33 


Control 


32 


6.35 


1.27 


6.60 


1 


.84 


6.47 


1.55 
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Table H-2 



Means and Standard Deviations for Pretreatment 
CLDMA Item 2 (Establish an Action Plan) Score 



Class/ Ins true tor 
Group 


N 


M 


Males 

SD 


Females 
M SD 


Totals 
M SD 


Experimental 


8 


4 


50 


1 


.29 


7 


.25 


0.96 


5 


.88 


1 .81 


Control 


d 


4 


50 


1 


.29 


7 


.25 


2. 22 


5 


.88 


2.23 


* ^2 ^xpeninenLax 


Q 
0 




75 


1 


.26 


5 


.25 


2.06 


4 


.50 


1 .77 


Control 


8 


6. 


25 


1 


.50 


5 


.75 


2.06 


6 


00 


1.69 


Experimental 


5 


5. 


50 


0 


.71 


5 


.00 


0.0 


5 


.20 


0.45 


Control 


8 


4. 


60 


2 


51 


5 


.00- 


0.0 


4 


.75 


1.91 


Experimental 


8 


5. 


75 


1 


.50 


6 


.25 


0.96 


• 6 


.00 


1 .20 


Control 


8 


6. 


00 


I 


83 


7 


.50 


1 .29 


6 


75 


1.67 


Totals Experimental 


29 


4. 


79 


1 


42 


6 


00 


1 .46 


5 


41 


1.55 


Control 


32 


5. 


29 


1 


90 


6 


47 


1.85 


5. 


84 


1 .94 



196 



Table H-3 



Means and Standard Deviations for Pre treatment CLDMA 
Item 3 (Clarify Values) Score 



1 

Class /Ins true tor 




Males 


Females 


Totals 


Group 
















: 


N 


M 


SD 


M 


SD 


M 


SD 


Experimental 


8 


5,25 


2.63 


7.75 


1.50 


6.50 


2.39 


Control 


8 


6.50 


1 .00 


8.00 


1 .41 


7 9*^ 

/ . £.J 


1 . 39 


Experimental 


8 


6.50 


2.38 


8.00 


1.15 


7.25 


1.91 


Control 


8 


7.25 


0.96 


4.75 


1 .71 


6.00 . 


1.85 


Experimental 


5 


7.00 


0.0 


6.00 


1.00 


6.40 


0.89 


Control 


8 


7.20 


1.48 


5.00 


1 .00 


6.38 


1.69 


Experimental 


8 


7.00 


0.82 


7.75 


0.96 


7.38 


0.92 


Control 


8 


7.00 


1 .63 


8.00 


2.00 


7.50 


1.77 


Totals Experimental 


29 


6.36 


1.91 


7.47 


1 .30 


6.93 


1.69 


Control 


32 


7.00 


i . 22 


6.53 


2.17 


6.78 


1.72 
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Table H-4 



Means and Standard Deviations for Pre treatment CLDMA 
Item 4 (Identify Alternatives) Score 



Class/Ins true tor 




Males 


Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


Experimental 


8 


4.00 


2.45 


6.75 


2.63 


5.38 


2.77 


Control 


8 


4.75 


0.50 


4.50 


1 91 


*♦ . D J 


1 


Experimental 


8 


5.75 


0.96 


6.25 


1.26 


6.00 


1.07 


Control 


8 


5.75 


1.50 


5.50 


2.65 


5.63 


2.00 


Experimental 


5 


5.00 


0.0 


6.00 


0.0 


5.60 


0.55 


Control 


8 


5.60 


3.05 


6.33 


1.53 


5.88 


2.47 


Experimental 


8 


8.00 


0.82 


7.00 


0.82 


• 7.50 


0.93 


Control 


8 


6.75 


2.06 


7.50 


1.73 


7.13 


1.81 


Totals ExP"imental 


29 


5.79 


2.08 


6.53 


1.46 


6.17 


1.79 


Control 


32 


5.71 


2.02 


5.93 


2.15 


5.81 


2.05 
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Table H-5 



Means and Standard Deviations for Pretreatment CLDMA 
Item 5 (Discover Probable Outcomes) Score 



Class/Ins true tor 




Males 




Females 


Totals 


Group 




















N 


M 


SD 




M 


SD 


M 


SD 


Experimental 


8 


5.25 


1.71 


6 


.25 


0.96 


5.75 


1.39 


Control 


8 


6.25 


0.96 


7 


.25 


1 .50 


6.75 


1.28 


^2 Experimental 


Q 
O 


5.50 


1.29 


7 


.23 


0.96 


6.38 


1.41 


Control 


8 


6.75 


0.96 


5 


.50 


. 1.29 


.. 6.13 


1.25 


^2 Experimental 


5 


5.50 


0.71 


6 


.00 


0.0 


5.80 


0.45 


Control 


8 


5.60 


1.82 


5 


67 


1.15 


5.63 


1.51 


Experimental 


8 


7.00 


0.82 


6 


50 


2.38 


6.75 


1.67 


Control 


8 


7.00 


1.63 


7 . 


50 


1 .73 


7.25 


1 .58 


Totals ^Pe»^i°iGntal 


29 


5.86 


1.35 


6. 


53 


1.36 


6.21 


1 .37 


Control 


32 


6.35 


1.41 


6. 


53 


1 .60 


6.44 


1 .48 
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Table H-6 



and Standard Deviations for Pretreatment CLDMA i 
(Eliminate Alternatives Systematically) Score 



Class / Ins t rue tor 




Mai 


es 


Females 




Totals 


Group 




















N 


M 


SD 


M 


SD 




M 


SD 


Experimental 


8 


5.00 


2.45 


6.75 


2.06 


5 


.88 


2.30 


Control 


8 


6.25 


1.50 


7.00 


2.16 


5 


.63 


1 77 


If 2 ^^P^^^'^^-^^^l 


8 


D . 7d 


1 .89 


7.-50 


0.58 


6 


.63 


1 .60 


Control 


8 


7.50 


0.58 


5.25 


2.06 


6 


.38 


1.85 


Experimental 


5 


6.50 


2.12 


6.00 


1.00 


6 


.20 


1 . 30 


Control 


8 


5.80 


2.17 


6.33 


0.58 


6 


.00 


1.69 


Experimental 


8 


7.25 


0.96 


7.00 


1.83 


7 


13 


1.36 


Control 


8 


7.00 


1.63 


7.25 


2.22 


7. 


13 


1.81 


Totals Experimental 


29 


6.07 


1.90 


6.87 


1 .46 


6. 


48 


1.70 


Control 


32 


6.59 


1.62 


6.47 


1.92 


6. 


53 


1. 74 



200 



215 



4 

'A 



Table H-7 

Means and Standard Deviations for Pretraatment CLDMA 
Item 7 (Start Action) Score 



Class/Instructor 




Males 




Feraales 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


„ , Experimental 
ill ^ 


8 


4.50 


1 . 73 


7.00 


0.82 


5.75 


1.83 


Control . 


8 


5.25 


0.96 


8.00 


0.82 


6.63 


1.69 


Experimental 

2 


8 


7.00 


2.45 


6.75 


1.71 


6.88 


1.96 


Control 


8 


8.00 


0.82 


5.25 


1.39 


6.63 


2.00 


Experimental 


5 


7.50 


0.71 


7.Q0 


1.00 


7.20 


0.84 


Control 


8 


7.00 


2.00 


6.00 


1.00 


6.63 


1.69 


Experimental 


8 


5.75 


1.50 


8.00 


0.0 


6.88 


1.55 


Control 


8 


5.75 


2.22 


9.00 


0.0 


7.38 


2.26 


^ ^ Experimental 
Totals ^ 


29 


6.0g 


2.00 


7.20 


1.08 


6.62 


1.68 


Control 


32 


6.53 


1.84 


7.13 


1.88 


6.81 


1.86 
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Table H-8 



Means and Standard Deviations for Pretreatment CLDMA 
Item 8 (Recycle If Necessary) Score 



Class/Ins true tor 
Group 




Males 




Females 


Totals 




N 


M 


SD 


M 


SD 


M 


SD 


1^ J Ci A per iiTie n l a ± 


Q 
0 


J . jU 


1 Q 1 


7.50 


1.29 


6.50 


1.85 


Control 


8 


6.50 


1.29 


7.25 


1.71 


6.88 


1.46 


i 

.^^ Experimental 


8 


5.25 


2.88 


6.25 


1.50 


5.75 


2.19 


; Control 


8 


7.25 


1.26 


4.25 


1.71 


5.75 


2.12 


1 

, Experimental 


5 


8.00 


0.0 


6.33 


0.58 


7.00 


1.00 


Control 


8 


6.20 


1.64 


5.33 


0.58 


5.88 


1.36 


Experimental 


8 


7.75 


1.26 


7.25 


1.50 


7.50 


1.31 


Control 


8 


6.50 


1.29 


8.50 


0.58 


7.50 


1.41 


Totals Experimental 


29 


6.43 


2.17 


6.87 


1.33 


6.66 


1.76 


Control 




6.87 


1.30 


6.40 


2.10 


6.50 


1.70 
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Table H-9 



Means and Standard Deviations for Posttreatment CLDMA 
Item 1 (Define the Problem) Score 



Class /Ins true tor 




Males 








Females 






Totals 


Group 


























N 


M 


SD 




M 


SD 




M 




ffl Experimental 


o 
O 


0 . ZD 


1 . 


2o 


8 


.25 


0. 


50 


7 


25 


1.39 


j Control 


8 


6.25 


0. 


96 


7 


.75 


0. 


50 


7 


00 


1.07 


i 

I E3<perimental 


8 


7.50 


0. 


58 


7 


.00 


1. 


41 


7 


25 


1.04 


Control 


8 


7.25 


1. 


50 


7 


.00 


0. 


82 


7 


13 


1.13 


Experimental 


5 


7.00 


1 


41 


7 


.67 


0 


58 


7 


40 


0.89 


Control 


8 


7.20 


1 


10 


4 


.67 


0 


58 


6 


.25 


1.58 


//4 Experimental 


8 


8.00 


0 


82 


8 


.00 


0 


82 


8 


.00 


0.76 


Control 


8 


8.00 


0 


82 


7 


.75 


1 


.89 


7 


.88 


1.36 


Totals Experimental 


29 


7.21 


1 


.12 


7 


.73 


0 


.96 


7 


.48 


1.06 


Control 


32 


7.18 


1 


.19 


6 


.93 


1 


.58 


7 


.06 


1.37 
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Table H~10 



Means and Standard Deviations for Posttreatment CLDMA Item 2 
(Establish an Action Plan) Score 



Class/Instructor 




Males 




Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


l^j^ Experimental 


8 


6.00 


1.41 


7.00 


0.0 1 

1 


6.50 


1.07 


j Control 

t 


8 


4.75 


2.06 


5.25 


2.22 


5 .00 


2.00 


i 

: Experimental 


8 


5.25 


0.96 


5.25 


2.87 


5.25 


1.98 


• Control 

1 


8 


6.25 


0.96 


7.25 


2.36 


6.75 


1.75 


1 

1 Experimental 


5 


6.00 


0.0 


6.33 


1 .15 


6.20 


0.84 


Control 


8 


6.00 


2.0 


5.33 


1.53 


5.75 


1.75 


ExpGrlmontal 


8" 


6.75 


2.50 


6.00 


K41 


6.38 


1.92 


Control 


8 


7.25 


0.96 


6.50 


1.73 


6.88 


1.36 


locals Experlmencal 


29 


6.00 


1.57 


6.13 


1.68 


6.07' 


1.60 


Control 


32 


6.06 


1.71 


6.13 


2.00 


6.09 


1.82 



) 
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Table H-11 



Means and Standard Deviations for Posttreatment CLDMA 
Item 3 (Clarify Values) Score 



Class /ins true tor 




Males 




Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


», Experimental 


8 


6.50 


2.08 


6.50 


1.91 


6.50 


1.85 


Control 


8 


6.50 


1.73 


7.75 


0.96 


7.13 


1.46 ■ 


.^.^ Rxperimcntnl 


8 


8.00 


1.41 


7.50 


1.29 


7.75 


1.28 


[ Control 

i 


8 


7.25 


6.50 


4.75 


1.71. 


6.00 


1.77 


1 

; ^^.^ Experimental,^. 


5 


8.00 


1.41 


7.67 


0.58 


7.80 


0.84 - 


Control 


8 


7.20 


2.05 


6.33 


1.53 


6.88 


1.81 


Experimental 


8 


8.00 


1.41 


8.00 


0.0 


8.00 


0.93 


Control 


8 


8.00 


0.82 


8.75 


0.50 


8.38 


0.74 


Totals Experimental 


29 


7.57 


1.60 


7.40 


1.24 


7.48 


1.40 


Control 


32 


7.24 


1 .44 


6.93 


1.94 


7.09 


1.67 
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Table H-12 



Means and Standard Deviations for Posttreatment CLDMA 
Item 4 (Identify Alternatives) Score 



Pi flSs/TnQhr"iir« hr»*- 




Males 


Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


... Experimental 


8 


6.25 


2.22 


4.50 


2.08 


5.38 


2.20 


Control 


8 


4.50 


1.73 


4.75 


0.50 


4.63 


1.19 


Experimental 


8 


6.75 


2.06 


6.75 


1.71 


6.75 


1.75 


Control 


8 


7.75 


1.26 


6.00 


1.83 


6.88 


1.73 


Experimental 


5 


6.50 


0.71 


7.67 


0.58 


7.20 


0.84 


Control 


8 


7.40 


1.82 


4.67 


1.53 


6.38 


2.13 


Experimental 


8 


6.75 


1.26 


8.00 


1.41 


7.38 


1.41 


Control 


8 


7.00 


2.45 


7.75 


1.26 


7.38 


1.85 • 


Totals Experimental 


29 


6.57 


1.60 


6.67 


2.02 


6.62 


1.80 


Control 


32 


6.71 


2.11 


5.87 


1.77 


6.31 


1.97 
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Table H-13 



Means and Standard Deviations for Posttreatment CLDMA 
Item 5 (Discover Probable Outcomes) Score 



oi.ass/ ms cruc cor 




Males 




Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


Experimental 


8 


4.75 


2.99 


6.25 


0.50 


5.50 


2.14 


Control 


8 


5.50 


2.38 


6.75 


1.50 


6.13 


1.96 


Experimental 


8 


7.50 


1.73 


7.25 


0.96 


7.38 


1.30 


Control 


8 


8.00 


0.82 


• 7.00 


1.63 


7.50 


1.31 


1 Experimental 


5 


6.00 


2.83 


7.33 


0.58 


6.80 


1.64 


Control 


8 


5.80 


1.92 


3.33 


0.58 


5.63 


1.51 


Experimental 


8 


7.25 


0.96 


7.75 


0.50 


7.50 


0.76 


Control 


8 


7.75 


0.96 


8.00 


0.32 


7.88 


0."87 


Totals Experimental 


29 


6.43 


2.24 


7.13 


0.83 


6.79 


1.68 


Control 


32 


6.71 


1.90 


6.87 


1.46 


6.78 


1.68 
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Table H-14 



Means and Standard Deviations for Posttreatment CLDMA Item 6 
(Eliminate Alternatives Systematically) Score 



Class/Instructor 
Group 




Males 




Females 


Totals 






M 




M 


SD 


M 


SD 


Experimental 


8 


6.00 


1.41 


6.50 


1.29 


6.25 


1.28 


Control 


8 


6.25 


1.26 


7.00 


0.82 


6.63 


1.06 


Experimental 


8 


7.75 


0.96 


7.00 


1.41 


7.38 


1.19 


Control 


8 


6.75 


1.50 


7.00 


1.41 


6.88 


1.36 


Experimental 


5 


7.00 


1.41 


7.67 


0.58 


7.40 


0.89 


Control 


8 


8.00 


0.71 


6.00 


1.00 


7.25 


1.28 


Experimental 


8 


7.25 


1.50 


7.25 


0.96 


7.25 


1.17 


Control 


8 


7.00 


1.63 


8.00 


1.41 


7.50 


1.51 


Totals Experimental 
Control 


29 
32 


7.00 
7.06 


1.36 
1.34 


7.07 
7.07 


1,10 
1.28 


7.03 
7.06 


1.21 
1.29 
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Table H-15 

Means and Standard Deviations for Posttreatment CLDMA 
Item 7 (Start Action) Score 



Class/Instructor 




Mai 




Females 


Totals 


Croup 


















N 


M 


SD 


M 


SD 


M 


SD 


Experimental 


8 


6.50 


1.91 


6.50 


1.00 


6.50 




Control 


8 


6.75 


0.96 


7.00 


1.41 


6.88 


1.13 


I^xperimantnl 


8 


7.50 


1.29 


6.00 


1.83 


6.75 


1.67 


Control 

1 


8 


7.00 


1.41 


5.75 


1.26 


6.38 


1.41 


Experimental 


5 


7.00 


0.0 


8.00 


1 .00 


7.60 


0.89 


Control 


8 


6.60 


1 .82 


5.00 


1.00 


6.00 


1.69 


Experimental 


8 


6.75 


1 .89 


7.75 


0.96 


7.25 


1.49 


Control 


8 


8.00 


1.41 


7.25 


2.06 


7.63 


1.69 


Totals Experimental 


29 


6.93 


1.49 


7.00 


1.41 


6.97 


1.43 


Control 


32 


7.06 


1.43 


6.75 


0.96 


6.72 


1.55 
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Table H-16 



Means and Standard Deviations for Post treatment CLDMA 
Item 8 (Recycle If Necessary) Score 



Class/Ins true tor 




Males 




Females 


Totals 


Group 


















N 


M 


SD 


M 


SD 


M 


SD 


Experimental 


8 


6.00 


1.83 


5.50 


1.29 


5.75 


1.49 


Control 


8 


6.00 


2.16 


7.25 


2.06 


6.63 


2.07 


Experimental 


8 


7.00 


1.15 


6.25 


1.89 


6.63 


1.51 


Control 


8 


7.25 


2.06 


6.25 


2.99 


6.75 


2.43 


Experimental 


5 


5.50 


0.71 


7.67. 


0.58 


6.80 


1.30 


Control 


8 


7.00 


1.22 


4.00 


1.73 


5.88 


2.03 


Experimental 


8 


8.00 


0.82 


8.00 


0.82 


8.00 


0.76 


Control 


8 


7.50 ' 


1.73 


7.50 


1.73 


7.50 


1.60 


Totals Experimental 


29 


6.79 


1.48 


6.80 


1.57 


6.79 


1.50 


Control 


32 


6.94 


1.71 


6.40 


2.38 


6.69 


2.04 
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APPENDIX I 

ANALYSIS OF VARIANCE OF CAREER DECISION-MAKING SKILLS ASSESSMENT 
EXERCISE (CDMSAE) TOTAL AND SUBSCORES AS A FUNCTION OF 
TREATMENT, SEX, AND CLASS/INSTRUCTOR 





Table I-l 






Analysis of Variance of 
Total Score on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 




Source of 
Variation 


ii 


Mean 
Square 


F 


P 


Main Effects 


e 
J 


353.406 


2, 656 


,035 


Treatment 


T 
X 


1007 .040 


7,567 




Sex 


1 


50,908 


0,383 


,539 


Class/Instructor 






1 AAA 


,188 


2-Way Interactions 


1 


168,151 


1,264 


9Qn 


Treatment x Sex 


1 


3,539 


0,027 


,871 


Treatment x Class/Instructor 


3 


286,021 


2,149 


,107 


Sex X Class/Instructor 


3 


92,253 


0.693 


,561 


3-Way Interaction 


3 


189,356 


1,423 


,249 


Treatment x Sex x Class/Instructor 


3 


189,356 


1,423 


, 249 


Explained 


15 


234,144 


1,759 


,073 


Residual 


45 


133,077 






Total 


60 


158,343 
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Table 1-2 



Analysis of Variance of 
"Define" Subscore on the CDMSAE as a' Function 
of Treatment, Sex, and Class/Instructor 



Source of 
Variation 



Mean 
Square 



Main Effects 
Treatment 
Sex 

Class / Ins true tor 



5 
1 
1 

3 



0.986 

4.499 
0.006 
0.23ft 



0.679 
3.097 
0.004 
0.164 



.642 
.085 
.949 
.920 



2-Way Interactions 
Treatment x Sex 
Treatment x Class/Instructor 
Sex X Class/Instructor 



1.71fi 
i.234 
2.552 
1.103 



1.182 
0.850 
1.757 
0.759 



.332 
.362 
.169 
.523 



3-Way Interaction 3 0.562 0.387 .763 

Treatmer.t x Sex x Class/Instructor 3 0.562 0.387 .763 



Explained 
Rep, 1 dual 
Total 



15 
45 
60 



1.242 
1.453 
1.400 



0.855 



.615 
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Table 1-3 



Analysis of Variance of 
"Establish" Subscore on Che CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 



Source of 
Variation 


df 


Mean 
Square 




-P - 


Main Effects 


5 


14,864 


2.607 


.037 


Treatment 


1 


20,144 


3.534 


.067 


Sex 


1 


1.932 


0.339 


.563 


Class /Tns trurtor 


3 


16,565 


2 906 


.045 


2-Way Interactions 


7 


7.173 


1.258 


.292 


Treatment x Sex 


1 


2.612 


0.458 


.502 


Treatment x Class/Instructor " 


3 


9.655 


1.694 


.182 


Sex X Class/Instructor 


3 


5.697 


0.999 


.402 


3-Way Interaction 


3 


9.306 


1.632 


.195 


Treatment x Sex x Class/Instructor 


3 


9.306 


1.632 


.195 


Explained 


15 


10.163 


1.783 


.068 


Residual 


45 


5.701 






Total 


60 


6.816 
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Table 1-4 



Analysis of Variance of 
"Clarify" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 



Source* of 
variation 


df 


Mean 
Square 


F 


P 


Main Effects 


5 


10.383 


•1.905 


.112 


Treatment 


1 


15,968 


2.929 


.094 


Sex 


1 


4.840 


0.888 


.351 


Class /Ins true tor 


3 


10.263 


1.883 


.146 


2-Way Interactions 


7 


8.944 


1.641 


.149 


Treatment x Sex 


1 


3.014 


0.553 


.461 


Treatment x Class/Instructor 


3 


12.929 


2.372 


.083 


Sex X Class/Instructor 


3 


6.212 


1.140 


.343 


3-Way Interaction 


3 


2.463 


0.452 


.717 


Treatment x Sex x Class/Instructor 


3 


2.463 


0;452 


.717 


Explained 


15 


8.128 


1.491 


.149 


Residual 


45 


5.451 






Total 


60 


6.120 
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Table 1-5 



Analysis of Variance of 
''Identify" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 



Source of Mean 
Variation .df Square 



Main Effects 5 3.476 1.424 .234 

Treatment 1 9.247 3.787 .058 

Sex 1 0.005 0.002 .964 

Class/Instructor 3 2.490 1.020 .393 

2- Way Interactions 7 3.440 1.409 .225 

Treatment x Sex 1 2.099 0.860 .359 

Treatment x Class/Instructor 3 5.451 2.232 .097 

Sex X Class/Instructor 3 1.991 0.815 .492 

3- Way Interaction 3 3.442 1.409 .252 

Treatment x Sex x Class/Instructor 3 3.442 1.409 .252 

Explained 15 3.453 1.414 .182 

Residual 45 2.442 

Total 60 2.695 
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Table 1-6 



Analysis of Variance of 
"DliBCover" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 



Source of 




Mean 






Variation 




Square 


I. 




Main Effects 


5 


28.876 


2.313 


.059 


Treatment 


1 


75.199 


6.023 


.018 


Sex 


1 


6.340 


0.508 


.480 


Class/Instructor 


3 


19.810 


1.587 


.206 


2-Way Interactions 


7 


12.370 


0.991 


.450 


Treatment x Sex 


1 


2.145 


0.172 


.680 


Treatment x Class/InstruQtor 


3 


21.414 


1.715 


.177 


Sex X Class/Instructor 


3 


5.284 


0.423 


.737 


3-Way Interaction 


3 


17.340 


1.389 


.258 


Treatment x Sex x Class/Instructor 


3 


17.340 


1.389 


.258 


Explained 


15 


18.866 


1.511 


.142 


Residual 


45 


12.486 






Total 


60 


14.081 
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Table 1-7 



Analysis of Variance of 
"Eliminate" Subscore on the CDMSAE as a Function 
of Treatment, Sex, and Class/Instructor 



Source of 




Mean 






Variation 




Square 


F 




Main Effects 


5 


11,603 


3,371 


,011 


Treatment 


1 


42,835 


12,443 


,001 


Sex 


1 


0,599 


0,174 


,679 


Class/Instructor 


3 


4,742 


1,377 


,262 


2-Way Interactions 


7 


1,805 


0,524 


,811 


Treatment x Sex 


1 


0,141 


0,041 


,840 


Treatment x Class/Instructor 


3 


1,508 


0,438 


,727 


Sex X Class/Instructor 


3 


2,696 


0,783 


,510 


3-Way Interaction 


3 


7,782 


2.261 


,094 


Treatment x Sex x Class/instructor 


3 


7,782 


2,261 


,094 


Explained 


15 


6,267. 


1,820 


,062 


Residual 


45 


3,443 






Total 


60 


4,149 
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Table 1-8 



Analysis of Variance of 
"Start" Subsr-ore on the CDMSAE as a .Function 
of Treatment, Sex, and Class/Instractor 



Source of 
Variation 



jdf 



Mean 
Square 



Main Effects 
Treatment 
Sex 

Class/Instructor 



2.250 
8.243 
0.160 
.723 



1.824 
6.679 
0.130 
0.586 



.127 
.013 
.720 
.628 



2-Way Interactions 
Treat'jient x Sex 
Treatiaant x Class/Instructor 
Sex X Class/Instructor 



1.208 
0.001 
1.450 
1.276 



0.979 
0.001 
1.175 
1.034 



.459 
.977 
.330 
.387 



3-Way Interaction 3 1.226 

Treatment X Sex x Class/Instructor 3 1.226 



0.994 
0.994 



.404 
.404 



Explained 

Residual 

Total 



15 
45 
60 



1.559 
1.234 
1.315 



1.263 



.264 
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